









本发明涉及机器人技术领域,特别涉及一种机器人交互行为的控制方法、装置及机器人。The invention relates to the field of robot technology, in particular to a method, a device and a robot for controlling the interaction behavior of a robot.
当今的机器人多为工业机器人,而工业机器人以无感知能力的居多。这些机器人的操作程序都是预先制定的,并按照预定程序重复无误地完成确定的任务。它们缺乏适应性,只有当涉及的对象相同时,才能产生一致的结果。Today's robots are mostly industrial robots, while industrial robots are mostly non-sense. The operating procedures of these robots are pre-defined and the determined tasks are completed without fail in accordance with the predetermined procedures. They lack adaptability and produce consistent results only when the objects involved are the same.
发明内容Summary of the invention
本发明实施例提供了一种机器人交互行为的控制方法、装置及机器人,以至少有效提高机器人自适应交互行为能力与智能化程度。The embodiment of the invention provides a method, a device and a robot for controlling the interaction behavior of the robot, so as to at least effectively improve the adaptive interaction behavior and the degree of intelligence of the robot.
在某些实施例中,一种机器人交互行为的控制方法,包括:获取机器人感知到的信息;根据感知到的信息、至少按照预先定义的感知单元生成感知数据,其中,该感知数据包括感知单元的标识和取值;查找与生成的感知数据匹配的控制条目,其中,每个控制条目包含触发条件和该触发条件触发的行为,每个触发条件由至少一个感知单元构成;如果查找到与上述生成的感知数据匹配的控制条目,使机器人执行查找到的控制条目中的行为。In some embodiments, a method for controlling interaction behavior of a robot includes: acquiring information perceived by a robot; generating, according to the sensed information, sensing data according to at least a predefined sensing unit, wherein the sensing data includes a sensing unit Identification and value; a control entry matching the generated perceptual data, wherein each control entry includes a trigger condition and an action triggered by the trigger condition, each trigger condition being composed of at least one perceptual unit; if The generated sensed data matches the control entry, causing the robot to perform the behavior in the found control entry.
在某些实施例中,一种机器人交互行为的控制方法,包括:感知至少一项信息;根据感知到的信息、至少按照预先定义的感知单元生成感知数据,其中,感知数据包括感知单元的标识和取值;将生成的感知数据发送出去;接收与上述感知数据匹配的控制条目,其中,该控制条目包含触发条件和该触发条件触发的行为,触发条件由至少一个感知单元构成;执行接收到的控制条目中的交互行为。In some embodiments, a method for controlling interaction behavior of a robot includes: sensing at least one piece of information; generating sensing data according to at least a predefined sensing unit according to the perceived information, wherein the sensing data includes an identifier of the sensing unit And a value; sending the generated sensing data; receiving a control entry that matches the perceptual data, wherein the control entry includes a trigger condition and an action triggered by the trigger condition, and the trigger condition is formed by at least one sensing unit; The interaction behavior in the control entry.
在某些实施例中,一种机器人交互行为的控制方法,包括:提供包含多个控制条目的控制条目文档,其中,每个控制条目包含触发条件和该触发条件触发的行为,每个触发条件由至少一个预先定义的感知单元构成;将机器人的感知数据与控制条目进行匹配,以确定是否存在与所述机器人的感知数据匹配的控制条目,其中,机器人的感知数据根据机器人感知到的信息、至少按照预先定义的感知单元生成。In some embodiments, a method of controlling robot interaction behavior includes: providing a control entry document including a plurality of control entries, wherein each control entry includes a trigger condition and an action triggered by the trigger condition, each trigger condition Constructed by at least one predefined sensing unit; matching the sensing data of the robot with the control item to determine whether there is a control item matching the sensing data of the robot, wherein the sensing data of the robot is based on the information perceived by the robot, Generated at least according to a predefined perceptual unit.
在某些实施例中,一种机器人交互行为的控制装置,包括:获取模块,用于获取机器人感知到的信息;生成模块,用于根据感知到的信息、至少按照预先定义的感知单元生成感知数据,其中,感知数据包括感知单元的标识和取值;查找模块,用于查找与生成的感知数据匹配的控制条目,其中,每个控制条目包含触发条件和该触发条件触发的行为,每个触发条件由至少一个感知单元构成;执行模块,用于当查找到与生成的感知数据匹配的控制条目,使机器人执行查找到的控制条目中的行为。In some embodiments, a control device for robot interaction behavior includes: an acquisition module, configured to acquire information perceived by the robot; and a generation module, configured to generate a perception according to the perceptual information, according to at least a predefined sensing unit Data, wherein the sensing data includes an identifier and a value of the sensing unit; and a searching module, configured to search for a control entry that matches the generated sensing data, wherein each control entry includes a triggering condition and a behavior triggered by the triggering condition, each The trigger condition is composed of at least one sensing unit; the execution module is configured to cause the robot to perform the behavior in the found control item when the control item matching the generated sensing data is found.
在某些实施例中,一种机器人交互行为的控制装置,包括:感知模块,用于感知至少一项信息;生成模块,用于根据感知到的信息、至少按照预先定义的感知单元生成感知数据,其中,感知数据包括感知单元的标识和取值;发送模块,用于将生成的感知数据发送出去;接收模块,用于接收与所述感知数据匹配的控制条目的信息,其中,该控制条目包含触发条件和该触发条件触发的行为,触发条件由至少一个感知单元构成;执行模块,用于根据控制条目的信息执行该控制条目中的交互行为。In some embodiments, a control device for robot interaction behavior includes: a sensing module, configured to perceive at least one piece of information; and a generating module, configured to generate sensing data according to the perceptual information, according to at least a predefined sensing unit The sensing data includes an identifier and a value of the sensing unit, a sending module, configured to send the generated sensing data, and a receiving module, configured to receive information of a control entry that matches the sensing data, where the control entry The triggering condition is triggered by the triggering condition and the triggering condition is formed by the at least one sensing unit; and the executing module is configured to perform the interaction behavior in the control item according to the information of the control item.
在某些实施例中,一种机器人交互行为的控制装置,包括:接收模块,用于接收机器人的感知数据,其中,感知数据根据机器人感知到的信息、至少按照预先定义的感知单元生成;查找模块,用于查找与机器人的感知数据匹配的控制条目,其中,每个控制条目包含触发条件和该触发条件触发的行为,每个触发条件由至少一个感知单元构成;执行模块,用于当查找到与机器人的感知数据对应的控制条目,使机器人执行查找到的控制条目中触发条件触发的行为。In some embodiments, a control device for robot interaction behavior includes: a receiving module, configured to receive the sensory data of the robot, wherein the sensory data is generated according to the information perceived by the robot, at least according to a predefined sensing unit; a module for finding a control entry that matches the perceptual data of the robot, wherein each control entry includes a trigger condition and an action triggered by the trigger condition, each trigger condition being composed of at least one perceptual unit; an execution module for when searching A control entry corresponding to the sensory data of the robot causes the robot to perform a behavior triggered by the trigger condition in the found control entry.
在某些实施例中,一种机器人交互行为的控制装置,包括:控制条目文档,用于提供包含多个控制条目的控制条目文档,其中,每个控制条目包含触发条件和该触发条件触发的行为,每个触发条件由至少一个预先定义的感知单元构成;匹配模块,用于将机器人的感知数据与控制条目进行匹配,以确定是否存在与机器人的感知数据匹配的控制条目,其中,感知数据根据机器人感知到的信息、至少按照预先定义的感知单元生成。In some embodiments, a control device for robot interaction behavior includes: a control entry document for providing a control entry document including a plurality of control entries, wherein each control entry includes a trigger condition and the trigger condition triggering Behavior, each trigger condition is composed of at least one predefined sensing unit; a matching module is configured to match the sensing data of the robot with the control item to determine whether there is a control item that matches the sensing data of the robot, wherein the sensing data According to the information perceived by the robot, it is generated according to at least a predefined sensing unit.
上述方法可以由机器人执行,其中所述机器人具有:一个或多个单元,存储器,以及一个或多个保存在存储器中以执行这些方法的模块、程序或指令集。The above method can be performed by a robot having one or more units, a memory, and one or more modules, programs, or sets of instructions stored in memory to perform the methods.
用于执行上述方法的指令可以包括在被配置为由一个或多个处理器执行的计算机程序产品中。Instructions for performing the above methods may be included in a computer program product configured to be executed by one or more processors.
在本发明实施例中,提出了一种机器人的控制方法、装置及机器人,预先定义了控制机器人交互行为的感知单元,将其作为控制机器人交互行为的最小单元,根据感知单元设置触发条件和触发条件所触发的交互行为,得到控制机器人的控制条目,统一了机器人控制的输入输出标准,使得非技术人员也可以编辑机器人的行为,从而便于控制机器人的交互行为,有效提高机器人自适应交互行为能力与智能化程度。In the embodiment of the present invention, a control method, device and robot for a robot are proposed, and a sensing unit for controlling the interaction behavior of the robot is defined in advance as a minimum unit for controlling the interaction behavior of the robot, and a trigger condition and a trigger are set according to the sensing unit. The interaction behavior triggered by the condition, the control item of the control robot is obtained, and the machine is unified.The input and output standards controlled by the human person enable non-technical personnel to edit the behavior of the robot, thereby facilitating the control of the interactive behavior of the robot, and effectively improving the adaptive interaction behavior and intelligence of the robot.
此处所说明的附图用来提供对本发明的进一步理解,构成本申请的一部分,并不构成对本发明的限定。在附图中:The drawings described herein are provided to provide a further understanding of the invention, and are not intended to limit the invention. In the drawing:
图1说明根据本发明某些实施例的机器人的结构示意图;1 illustrates a schematic structural view of a robot in accordance with some embodiments of the present invention;
图2说明根据本发明某些实施例的机器人的控制数据的生成方法的流程图;2 illustrates a flow chart of a method of generating control data for a robot in accordance with some embodiments of the present invention;
图3说明根据本发明某些实施例的机器人交互行为的控制方法的流程图一;3 illustrates a flow chart 1 of a method of controlling robot interaction behavior in accordance with some embodiments of the present invention;
图4说明根据本发明某些实施例的机器人交互行为的控制方法的流程图二;4 illustrates a flow chart 2 of a method of controlling robot interaction behavior in accordance with some embodiments of the present invention;
图5说明根据本发明某些实施例的机器人交互行为的控制方法的流程图三;5 illustrates a flow chart 3 of a method of controlling robot interaction behavior in accordance with some embodiments of the present invention;
图6说明根据本发明某些实施例的机器人的控制数据的生成装置的结构框图;6 is a block diagram showing the structure of a device for generating control data of a robot according to some embodiments of the present invention;
图7说明根据本发明某些实施例的机器人交互行为的控制装置的结构框图一;Figure 7 illustrates a block diagram 1 of a control apparatus for robot interaction behavior in accordance with some embodiments of the present invention;
图8说明根据本发明某些实施例的机器人交互行为的控制装置的结构框图二;8 is a block diagram showing the structure of a control device for robot interaction behavior according to some embodiments of the present invention;
图9说明根据本发明某些实施例的机器人交互行为的控制装置的结构框图三;以及9 illustrates a block diagram 3 of a control apparatus for robot interaction behavior in accordance with some embodiments of the present invention;
图10说明根据本发明某些实施例的机器人交互行为的控制装置的结构框图四。Figure 10 illustrates a block diagram of a block diagram of a control device for robot interaction behavior in accordance with some embodiments of the present invention.
现在详细参考附图中描述的实施例。为了全面理解本发明,在以下详细描述中提到了众多具体细节。但是本领域技术人员应该理解,本发明可以无需这些具体细节而实现。在其他实例中,不详细描述公知的方法、过程、组件和电路,以免不必要地使实施例模糊。Reference is now made in detail to the embodiments described in the drawings. In order to fully understand the invention, numerous specific details are recited in the following detailed description. However, it will be understood by those skilled in the art that the present invention may be practiced without these specific details. In other instances, well-known methods, procedures, components, and circuits are not described in detail to avoid unnecessarily obscuring the embodiments.
图1说明根据本发明某些实施例的机器人的结构示意图。机器人100包括存储器102、存储器控制器104、一个或多个处理单元(CPU)106、外设接口108、射频(RF)电路114、音频电路116、扬声器118、麦克风120、感知子系统122、姿态传感器132、摄像机134、触觉传感器136以及一个或多个其他感知装置138,以及外部接口140。这些组件通过一条或多条通信总线或信号线110进行通信。1 illustrates a schematic structural view of a robot in accordance with some embodiments of the present invention. The robot 100 includes a memory 102, a
应当理解,机器人100只是机器人100的一个实例,该机器人100的组件可以比图示具有更多或更少的组件,或具有不同的组件配置。例如,在某些实施例中,机器人100可以包括一个或多个CPU 106、存储器102、一个或多个感知装置(例如如上所述的感知装置),以及一个或多个保存在存储器102中以执行机器人交互行为控制方法的模块、程序或指令集。图1所示的各种组件可以用硬件、软件或软硬件的组合来实现,包括一个或多个信号处理和/或专用集成电路。It should be understood that the robot 100 is just one example of the robot 100, which may have more or fewer components than the illustration, or have different component configurations. For example, in some embodiments, the bot 100 can include one or
在某些实施例中,机器人100可以是具有生物外形(例如,人形等)的机电设备,还可以是不具有生物外形但具有人类特征(例如,语言交流等)的智能装置,该智能装置可以包括机械装置,也可以包括由软件实现的虚拟装置(例如,虚拟聊天机器人等)。虚拟聊天机器人可以通过其所在的设备感知到信息,其所在的设备包括电子设备,例如手持电子设备、个人计算机等。In some embodiments, the robot 100 may be an electromechanical device having a biological shape (eg, a humanoid, etc.), or may be a smart device that does not have a biological appearance but has human characteristics (eg, language communication, etc.), the smart device may Mechanical devices are also included, as well as virtual devices implemented by software (eg, virtual chat bots, etc.). The virtual chat bot can perceive information through the device in which it is located, and the device in which it is located includes electronic devices such as handheld electronic devices, personal computers, and the like.
存储器102可包括高速随机存取存储器,并且还可包括非易失性存储器,例如一个或多个磁盘存储设备、闪存设备或其他非易失性固态存储设备。在某些实施例中,存储器102还可以包括远离一个或多个CPU 106的存储器,例如经由RF电路114或外部接口140以及通信网络(未示出)访问的网络附加存储器,其中所述通信网络可以是因特网、一个或多个内部网、局域网(LAN)、广域网(WLAN)、存储局域网(SAN)等,或其适当组合。存储器控制器104可控制机器人100的诸如CPU 106和外设接口108之类的其他组件对存储器102的访问。Memory 102 can include high speed random access memory and can also include non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid state storage devices. In some embodiments, memory 102 may also include memory remote from one or
外设接口108将设备的输入和输出外设耦接到CPU 106和存储器102。上述一个或多个处理器106运行各种存储在存储器102中的软件程序和/或指令集,以便执行机器人100的各种功能,并对数据进行处理。
在某些实施例中,外设接口108、CPU 106以及存储器控制器104可以在单个芯片,例如芯片112上实现。而在某些其他实施例中,它们可能在多个分立芯片上实现。In some embodiments,
RF电路114接收并发送电磁波。该RF电路114将电信号变换成电磁波,或是将电磁波变换成电信号,并且经由电磁波来与通信网络以及其他通信设备进行通信。该RF电路114可以包括用于执行这些功能的公知电路,包括但不局限于天线系统、RF收发机、一个或多个放大器、调谐器、一个或多个振荡器、数字信号处理器、CODEC芯片组、用户身份模块(SIM)卡、存储器等等。该RF电路112可以通过无线通信来与网络和其他设备进行通信,该网络例如又名万维网(WWW)的因特网、内部网和/或诸如蜂窝电话网络之类的无线网络、无线局域网(LAN)和/或城域网(MAN)。The
上述无线通信可以使用多种通信标准、协议和技术中的任何一种,包括但不局限于全球移动通信系统(GSM)、增强型数据GSM环境(EDGE)、宽带码分多址(W-CDMA)、码分多址(CDMA)、时分多址(TDMA)、蓝牙、无线保真(Wi-Fi)(例如IEEE 802.11a、IEEE 802.11b、IEEE802.11g和/或IEEE 802.11n)、基于因特网协议的语音传输(VoIP)、Wi-MAX,用于电子邮件、即时消息传递和/或短消息服务(SMS)的协议,或任何其他合适的通信协议,包括在本文件提交日尚未开发出的通信协议。The above wireless communication may use any of a variety of communication standards, protocols, and technologies including, but not limited to, Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), Wideband Code Division Multiple Access (W-CDMA). ), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Wireless Fidelity (Wi-Fi) (eg IEEE 802.11a,IEEE 802.11b, IEEE 802.11g and/or IEEE 802.11n), Voice over Internet Protocol (VoIP), Wi-MAX, protocols for email, instant messaging, and/or short message service (SMS), or Any other suitable communication protocol, including communication protocols that have not been developed at the filing date of this document.
音频电路116、扬声器118和麦克风120提供了用户与机器人100之间的音频接口。音频电路116接收来自外设接口108的音频数据,将音频数据变换成电信号,并且将电信号传送到扬声器118。扬声器将电信号变换成人类可听见的声波。音频电路116还接收由麦克风118从声波变换的电信号。该音频电路116将电信号变换成音频数据,并且将音频数据传送到外设接口108,以便进行处理。音频数据可以由外设接口108从存储器102和/或RF电路114中检索出,和/或传送到存储器102和/或RF电路114。
在某些实施例中,可以包括多个麦克风120,多个麦克风120分布可以在不同位置,根据不同位置的麦克风120、按照预定策略确定声音发出的方向。应当理解,也可以通过某些传感器来识别声音方向。In some embodiments, a plurality of
在某些实施例中,音频电路116还包括头戴送受话器插孔(未示出)。该头戴送受话器插孔提供音频电路114与可拆装的音频输入/输出外设之间的接口,举例来说,该音频输入/输出外设既可以是纯输出耳机,也可以是同时具有输出(用于单耳或双耳的耳机)和输入(麦克风)的头戴送受话器。In some embodiments,
在某些实施例中,还包括语音识别装置(未示出),用于实现语音到文字的识别,以及根据文字合成语音。语音识别装置可以用硬件、软件或软硬件的组合来实现,包括一个或多个信号处理和/或专用集成电路。音频电路116接收来自外设接口108的音频数据,将音频数据变换成电信号,语音识别装置可以对音频数据进行识别,将音频数据转换为文本数据。语音识别装置还可以根据文字数据合成音频数据,通过音频电路116将音频数据变换成电信号,并且将电信号传送到扬声器118。In some embodiments, a speech recognition device (not shown) is also included for implementing speech-to-text recognition and synthesizing speech based on text. The speech recognition device can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits. The
感知子系统122提供机器人100的感知外设和外设接口108之间的接口,感知外设例如姿态传感器132、摄像机134、触觉传感器136和其他感知装置128。感知子系统122包括姿态控制器124、视觉控制器126、触觉控制器128以及一个或多个其他感知装置控制器130。所述一个或多个其他感知装置控制器130接收/发送来自/去往其他感知装置138的电信号。所述其他感知装置138可包括温度传感器、距离传感器、接近觉传感器、气压传感器以及空气质量检测装置等等。Perception subsystem 122 provides an interface between the perceptual peripherals of robot 100 and
在某些实施例中,机器人100可以具有多个姿态控制器124,以控制机器人100的不同肢体,机器人的肢体可以包括但不限于手臂、足和头部。相应的,机器人100可以包括多个姿态传感器132。在某些实施方式中,机器人100可以不具备姿态控制器124和姿态传感器132,机器人100可以是固定形态,不具备手臂、足等机械活动部件。在某些实施例中,机器人100的姿态可以不是机械的手臂、足和头部,也可以采用可变形的构造。In some embodiments, the robot 100 can have a plurality of
机器人100还包括用于为各种组件供电的电源系统142。该电源系统142可以包括电源管理系统、一个或多个电源(例如电池、交流电(AC))、充电系统、电源故障检测电路、电源转换器或逆变器、电源状态指示器(例如发光二极管(LED)),以及与便携式设备中的电能生成、管理和分布相关联的其他任何组件。充电系统可以是有线充电系统,或者也可以是无线充电系统。The robot 100 also includes a power system 142 for powering various components. The power system 142 can include a power management system, one or more power sources (eg, batteries, alternating current (AC)), charging systems, power failure detection circuits, power converters or inverters, power status indicators (eg, light emitting diodes (eg LED)), as well as any other components associated with power generation, management, and distribution in portable devices. The charging system can be a wired charging system or a wireless charging system.
在某些实施例中,软件组件包括操作系统144、通信模块(或指令集)146、交互行为控制装置(或指令集)148以及一个或多个其他装置(或指令集)150。In some embodiments, the software components include an operating system 144, a communication module (or set of instructions) 146, an interactive behavior control device (or set of instructions) 148, and one or more other devices (or sets of instructions) 150.
操作系统144(例如Darwin、RTXC、LINUX、UNIX、OS X、WINDOWS或是诸如Vxworks之类的嵌入式操作系统)包括用于控制和管理常规系统任务(例如内存管理、存储设备控制、电源管理等等)以及有助于各种软硬件组件之间通信的各种软件组件和/或驱动器。Operating system 144 (eg, Darwin, RTXC, LINUX, UNIX, OS X, WINDOWS, or an embedded operating system such as Vxworks) includes controls and management of general system tasks (eg, memory management, storage device control, power management, etc.) Etc.) and various software components and/or drivers that facilitate communication between various hardware and software components.
通信模块146有助于经一个或多个外部接口140而与其他设备进行通信,并且它还包括用于处理RF电路114和/或外部接口140接收的数据的各种软件组件。外部接口140(例如通用串行总线(USB)、FIREWIRE等等)适合于直接或者经网络(例如因特网,无线LAN等等)间接耦接到其他设备。Communication module 146 facilitates communication with other devices via one or more external interfaces 140, and it also includes various software components for processing data received by
在某些实施例中,机器人100还可以包括显示装置(未示出),显示装置可以包括但不限于触敏显示器、触摸板等。上述一个或多个其他装置150可以包括图形模块(未示出),图形模块包括用于在显示装置上呈现和显示图形的各种已知软件组件。注意术语“图形”包括可以显示给用户的任何对象,包括但不局限于文本、网页、图标(例如包括软按键在内的用户界面对象)、数字图像、视频、动画等等。触敏显示器或触摸板还可以用于用户输入。In some embodiments, the robot 100 may also include a display device (not shown), which may include, but is not limited to, a touch sensitive display, a touch pad, and the like. One or more of the other devices 150 described above can include a graphics module (not shown) that includes various known software components for presenting and displaying graphics on the display device. Note that the term "graphics" includes any object that can be displayed to a user, including but not limited to text, web pages, icons (eg, user interface objects including soft keys), digital images, video, animation, and the like. Touch sensitive displays or touch pads can also be used for user input.
机器人100通过例如姿态传感器132、摄像机134、触觉传感器136和其他感知装置128、麦克风120等感知外设感知机器人10的外部环境和机器人本身的状况,机器人100感知到的信息经由感知外设对应控制装置处理,并交由一个或多个CPU 106处理。机器人100对环境的感知包括但不限于自身的传感器(例如姿态传感器132、摄像机134、触觉传感器136和其他感知装置128)检测到的信息,还可以是与机器人100相连的外部装置(未示出)检测到的信息,机器人100与外部装置之间建立通信连接,机器人100和外部装置通过该通信连接传输数据。外部装置包括各种类型的传感器、智能家居设备等。The robot 100 senses the external environment of the robot 10 and the condition of the robot itself by, for example, the attitude sensor 132, the
在某些实施例中,机器人100感知到的信息包括但不限于声音、图像、环境参数、触觉信息、时间、空间等。环境参数包括但不限于温度、湿度、气体浓度等;触觉信息包括但不限于与机器人100的接触,包括但不限于与触敏显示器的接触、与触觉传感器的接触或靠近,触觉传感器可以设置在机器人的头部、手臂等部位(未示出),应当说明的是还包括其他形式的信息。声音可以包括语音和其他声音,声音可以是麦克风120采集到的声音,也可以是存储器102中存储的声音;语音可以包括但不限于人类说话或唱歌等。图像可以是单张图片或视频,图片和视频包括但不限于由摄像机134拍摄得到,也可以从存储器102中读取或者通过网络传输到机器人100。In some embodiments, the information perceived by the robot 100 includes, but is not limited to, sound, images, environmental parameters, haptic information, time, space, and the like. Environmental parameters include, but are not limited to, temperature, humidity, gas concentration, etc.; tactile information includes, but is not limited to, contact with the robot 100, including but not limited to contact with a touch sensitive display, contact or proximity to a tactile sensor, and the tactile sensor can be placed at The head, arm, etc. of the robot (not shown) should be described to include other forms of information. The sound may include voice and other sounds, the sound may be the sound collected by the
机器人100感知的信息不仅包括机器人100外部的信息,还可以包括机器人100自身的信息,包括但不限于机器人100的电量、温度等信息。例如,可以在感知到机器100的电量低于20%时,使机器人100移动到充电位置自动充电。The information perceived by the robot 100 includes not only information external to the robot 100 but also information of the robot 100 itself, including but not limited to information such as the amount of power, temperature, and the like of the robot 100. For example, the robot 100 can be moved to the charging position for automatic charging when it is perceived that the power of the machine 100 is less than 20%.
应当理解,机器人100不限于通过上述的方式感知到信息,还可以通过其他形式感知到信息,包括在本文件提交日尚未开发出的感知技术。此外,机器人100的感知装置也不限于设置在机器人100上的感知装置,还可以包括与机器人100关联而未设置在机器人100上的感知装置,例如各种用于感知信息的传感器。作为一个示例,机器人100可以与设置在一定区域内的温度传感器、湿度传感器(未示出)等关联,通过这些传感器感知到相应的信息。机器人100可以通过多种类型的通信协议与这些传感器通信,以从这些传感器获取信息。It should be understood that the robot 100 is not limited to perceiving information in the manner described above, but may also perceive information in other forms, including perceptual techniques that have not been developed at the filing date of this document. Further, the sensing device of the robot 100 is not limited to the sensing device provided on the robot 100, and may also include a sensing device associated with the robot 100 and not provided on the robot 100, such as various sensors for sensing information. As an example, the robot 100 may be associated with a temperature sensor, a humidity sensor (not shown), or the like disposed within a certain area through which the corresponding information is perceived. The robot 100 can communicate with these sensors through various types of communication protocols to obtain information from these sensors.
在某些实施例中,可以根据预设的条件设定机器人100感知的信息,这些条件可以包括但不限于设定机器人100感知哪些信息、在什么时间感知信息等。例如,可以设定在于用户语音对话时,感知用户的声音、追踪用户的面部、识别用户的姿态等,而不感知其他信息、或者在生成感知单元时降低其他信息的作用、或者对感知到的其他信息进行处理等;或者,在某一时间段(例如,用户外出、机器人100单独在室内的时间内)感知环境参数、感知图像和视频数据,通过环境参数判断是否需要与空调等设备交互,通过图像和视频数据判断室内是否有陌生人进入等。应当理解,设定感知的信息的条件并不限于此,上述条件仅作为举例说明,可以根据情况设定机器人100需要感知的信息。In some embodiments, the information perceived by the robot 100 may be set according to preset conditions, which may include, but are not limited to, setting which information the robot 100 perceives, when to perceive the information, and the like. For example, it may be set to sense the user's voice, track the user's face, recognize the user's gesture, etc., in the user's voice conversation, without perceiving other information, or reducing the effect of other information when generating the sensing unit, or sensing the Other information is processed, etc.; or, during a certain period of time (for example, when the user goes out, the robot 100 is indoors alone), the environmental parameters, the perceived image, and the video data are sensed, and the environmental parameters are used to determine whether it is necessary to interact with the air conditioner or the like. Use image and video data to determine if there are strangers entering the room. It should be understood that the condition for setting the perceived information is not limited thereto, and the above conditions are merely exemplified, and the information that the robot 100 needs to perceive may be set depending on the situation.
关于感知单元About the sensing unit
定义至少一个感知单元,感知单元作为控制机器人100的最小单元(或者称为最小输入单元),机器人100至少根据感知单元做出交互行为。机器人100的交互行为可以受到一个或多个感知单元控制,例如,当一个或多个感知单元的取值发生变化时,机器人100可以响应这些变化做出交互行为;或者,当一个或多个感知单元的取值在某一取值范围内或等于某一值时,机器人100可以响应感知单元做出交互行为。应当理解,感知单元对机器人100交互行为的控制不限于上述情况,上述情况仅作为举例说明。At least one sensing unit is defined, which is the smallest unit (or referred to as a minimum input unit) that controls the robot 100, and the robot 100 makes interactive behavior based on at least the sensing unit. The interaction behavior of the robot 100 may be controlled by one or more sensing units, for example, when the values of one or more sensing units change, the robot 100 may react to the changes in response to the changes; or, when one or more perceptions When the value of the unit is within a certain value range or equal to a certain value, the robot 100 can perform an interactive behavior in response to the sensing unit. It should be understood that the control of the interaction behavior of the robot 100 by the sensing unit is not limited to the above case, and the above case is merely illustrative.
在某些实施例中,感知单元可以包括多个层级,高层级的感知单元可以包含低层级的一个或多个感知单元。在某些实施例中,高层级的感知单元可以包含与其相邻的低层级的一个或多个感知单元,同一高层级的感知单元可以包含不同的低层级的感知单元。在时间上,合成高层级的感知单元的低层级感知单元包括但不限于同一时间或时间段的低层级感知单元,以及该时间或时间段之前的历史的低层级的感知单元。在某些实施例中,高层级的感知单元由不同时间的低层级感知单元确定。In some embodiments, the sensing unit can include multiple levels, and the higher level sensing unit can include one or more sensing units of the lower level. In some embodiments, the higher level perceptual unit may include one or more perceptual units of the lower level adjacent thereto, and the sensing unit of the same higher level may include different lower level perceptual units. In time, the low-level sensing units that synthesize the high-level sensing units include, but are not limited to, low-level sensing units of the same time or time period, and historical low-level sensing units of the time or time period. In some embodiments, the higher level perceptual units are determined by lower level sensing units at different times.
在某些实施例中,感知单元的取值可以是一个或一组值,也可以是一个或多个取值的范围。可以根据机器人100感知到的信息确定感知单元的取值,一个感知单元可以由感知到的一项或多项信息确定,同一感知单元可以由感知到的不同数据来确定。感知到的信息可以包括实时感知到的信息,或者历史感知到的信息(例如过去某一时刻或某段时间感知到的信息)。在某些情况下,感知单元的取值由实时感知到的信息和历史感知到的信息共同确定。In some embodiments, the value of the sensing unit may be one or a set of values, or may be a range of one or more values. The value of the sensing unit may be determined according to the information perceived by the robot 100. One sensing unit may be determined by one or more pieces of information that is perceived, and the same sensing unit may be determined by different data that is perceived. The perceived information may include real-time perceived information, or historically perceived information (such as information perceived at a certain time or some time in the past). In some cases, the value of the sensing unit is determined by the information perceived in real time and the information perceived by the history.
作为一个例子,可以设置听觉(ear)、视觉(eye)、时间(timer)、是否有人在家(so_at_home)以及环境(environment)几个感知单元。听觉描述听到的语音,在机器人100接收到声音时,对接收到的声音进行语音识别处理,识别得到声音中语音的文本,听觉的取值可以是听到的语音的文本;在某些实施例中,视觉还可以包括声音的方向,声音的方向以机器人的面部为参考,包括左、右、前、后等方向。视觉描述视频监控情况,机器人100可以对图像或视频进行分析,判断当前是否有人或者是否有移动,视觉的取值可以包括是否有人、是否有移动等等。是否有人在家的取值可以是“0”或“1”,“0”表示没有人在家,“1”表示有人在家。时间描述时间信息,其取值可以是一个时间点或者一个时间范围,例如每年2月1日14点整。环境描述环境情况,包括温度、湿度、噪音、PM2.5、空气中的燃气的ppm、空气中的一氧化碳含量、空气中的氧气含量等,其取值可以是每种参数的值或者范围。As an example, it is possible to set ear, eye, timer, whether there are people at home (so_at_home), and environment (pervironment). The audible description describes the voice that is heard, and when the robot 100 receives the sound, performs voice recognition processing on the received voice to identify the text of the voice in the voice, and the value of the audible voice may be the text of the voice that is heard; in some implementations In the example, the vision may also include the direction of the sound, and the direction of the sound is referenced to the face of the robot, including left, right, front, back, and the like. Visually describing the video surveillance situation, the robot 100 can analyze the image or video to determine whether there is or is there a current movement, and the visual value can include whether or not someone has moved or not. Whether someone at home can be "0" or "1", "0" means no one is at home, and "1" means someone is at home. The time describes the time information, and the value may be a time point or a time range, for example, 14:00 every February 1st. The environment describes the environmental conditions, including temperature, humidity, noise, PM2.5, ppm of gas in the air, carbon monoxide content in the air, oxygen content in the air, etc., and the value may be the value or range of each parameter.
在某些实施例中,可以预定义感知单元的取值。预定义的感知单元的取值可以是一个或多个具体值、或者一个或多个取值范围。感知单元的取值可以是明确的值,也可以由通配符(或其类似)与明确的值共同构成,但不限于此。例如,感知单元为“语音”时,其取值可以是“*下雨*”,表示任意包含“下雨”的语音信息;或者其取值可以是“*[下有]雨*”,表示任意包含“下雨”或“有雨”的语音信息。In some embodiments, the value of the sensing unit can be predefined. The value of the predefined sensing unit may be one or more specific values, or one or more ranges of values. The value of the sensing unit may be an explicit value, or may be formed by a wildcard (or the like) together with an explicit value, but is not limited thereto. For example, when the sensing unit is “speech”, the value may be “*rain*”, indicating that any voice information containing “raining” is included; or the value may be “*[below] rain*”, indicating Any voice message that contains "rain" or "rain".
机器人100可以根据感知单元和感知到的信息生成感知数据,感知数据可以包括一项或多项感知单元,感知数据中包括感知单元的标识和取值。感知数据中每个感知单元的取值参见对感知单元的描述。机器人100根据感知到的信息、按照感知单元生成感知数据,可以采用多种分析方法根据感知到的信息得到感知单元的取值,例如,通过语音识别技术得到语音的文本、通过图像识别技术分析感知到的图像中是否存在人像、通过人像(面部)识别技术确定人像的属性等。应当理解,机器人100不限于通过上述的方式得到感知单元的取值,还可以通过其他方式,包括在本文件提交日尚未开发出的处理技术。The robot 100 may generate the sensing data according to the sensing unit and the perceived information, and the sensing data may include one or more sensing units, where the sensing data includes the identification and value of the sensing unit. For the value of each sensing unit in the sensing data, refer to the description of the sensing unit. The robot 100 generates the sensing data according to the perceived information according to the sensing unit, and can obtain the value of the sensing unit according to the perceived information by using various analysis methods, for example, obtaining the text of the voice through the voice recognition technology, and analyzing the sensing through the image recognition technology. Whether there is a portrait in the image to be obtained, the attribute of the portrait is determined by the portrait (face) recognition technique, and the like. It should be understood that the robot 100 is not limited to obtaining the value of the sensing unit by the above manner, and may also include processing techniques that have not been developed at the filing date of this document by other means.
作为一个非限制性示例,可预先设定多个感知单元,应当理解下述示例性感知单元的设置不是对感知单元的划分、或感知单元的数量、或感知单元的表达的限定,实际上任何感知单元的划分都是可以被考虑的。感知单元的示例如表1所示。As a non-limiting example, a plurality of sensing units may be preset, and it should be understood that the setting of the following exemplary sensing unit is not a division of the sensing unit, or a limitation of the number of sensing units, or the expression of the sensing unit, in fact any The division of the sensing unit can all be considered. An example of the sensing unit is shown in Table 1.
表1 感知单元示例表Table 1 Perceptual unit example table
以表1中感知单元的定义,以下给出了一个示例性感知数据,应当理解,以下感知数据并不是对感知数据的元素个数、或感知数据的定义、或感知数据的格式、或感知数据的表达方式的限定。一个示例情况的JSON感知数据表示如下,但不限于此,其他方式也是可行的。With the definition of the sensing unit in Table 1, an exemplary sensing data is given below. It should be understood that the following sensing data is not the number of elements of the sensing data, or the definition of the sensing data, or the format of the sensing data, or the sensing data. The definition of the way of expression. The JSON-aware data of an example case is expressed as follows, but is not limited thereto, and other methods are also possible.
在该示例在感知数据中,“vision_human_position”记录了人类用户在相对于机器装置的后面(“back”),“back”也可以用其他字符表示,能区分开不同的位置即可,应当理解位置也可以用“角度值”表示,例如“vision_human_position”:“45°”等。“sensing_touch”记录了人类用户在机器装置上的触摸,触摸的位置为手(“hand”),“hand”也可以用其他字符表示,能区分开不同的位置即可,应当理解触摸位置可以由多个,“sensing_touch”的值可以为数组,其记录多个位置。“audio_speak_txt”记录了人类用户所说的内容“很高兴见到你”,所说的内容也可以为音频数据。“audio_speak_language”记录了人类用户所说的语种“chinese”。“vision_human_posture”记录了人类用户的姿势“posture1”,“posture1”也可以用其他字符表示,能区分开不同的姿势即可。“system_date”记录了感知数据产生的日期“2016/3/16”,“system_time”记录了感知数据产生的时间“13-00-00”。“system_power”记录了机器装置的电量“80%”,应当理解,电量还可以按照其他方式标识。In this example, in the perceptual data, "vision_human_position" records that the human user is behind the "machine" ("back"), and "back" can also be represented by other characters, which can distinguish different positions, and should understand the position. It can also be expressed by "angle value", for example, "vision_human_position": "45°" or the like. "sensing_touch" records the touch of the human user on the machine device. The position of the touch is the hand ("hand"). The "hand" can also be represented by other characters. It can be distinguished from different positions. It should be understood that the touch position can be Multiple, the value of "sensing_touch" can be an array that records multiple locations. "audio_speak_txt" records what the human user said "very happy to see you", and the content can also be audio data. "audio_speak_language" records the language "chinese" spoken by human users. "vision_human_posture" records the human user's gesture "posture1", and "posture1" can also be represented by other characters, which can distinguish different postures. "system_date" records the date "2016/3/16" of the generation of the perceptual data, and "system_time" records the time "13-00-00" of the perceptual data generation. "system_power" records the "80%" of the power of the machine. It should be understood that the power can also be identified in other ways.
关于控制条目About control entries
基于预先定义的感知单元和预设的供机器人执行的交互行为,可以设置触发条件以及触发条件触发的交互行为。根据触发条件和触发条件触发的交互行为,生成用于响应机器人感知到的信息控制机器人交互行为的控制条目。控制条目可以具有唯一标识,以区分控制条目。Based on the pre-defined sensing unit and the preset interaction behavior for the robot, the trigger condition and the interaction behavior triggered by the trigger condition can be set. According to the interaction behavior triggered by the trigger condition and the trigger condition, a control item for controlling the interaction behavior of the robot in response to the information perceived by the robot is generated. Control entries can have unique identifiers to distinguish control entries.
触发条件可以由一个或多个感知单元构成,感知单元之间可以配置逻辑关系,逻辑关系包括但不限于“与”、“或”以及“非”等。在某些实施例中,触发条件可以包括构成触发条件的感知单元的标识和取值,感知单元的取值可以是一个或一组值或者一个或一组取值范围。感知单元的取值可以是明确的值,也可以由通配符(或其类似)与明确的值共同构成,但不限于此。例如,触发条件中感知单元为“语音”时,其取值可以是“*下雨*”,表示任意包含“下雨”的语音信息;或者其取值可以是“*[下有]雨*”,表示任意包含“下雨”或“有雨”的语音信息。The triggering condition may be composed of one or more sensing units, and the logical units may be configured between the sensing units, and the logical relationships include, but are not limited to, “and”, “or”, “not”, and the like. In some embodiments, the triggering condition may include an identification and a value of the sensing unit constituting the triggering condition, and the value of the sensing unit may be one or a set of values or one or a set of value ranges. The value of the sensing unit may be an explicit value, or may be formed by a wildcard (or the like) together with an explicit value, but is not limited thereto. For example, when the sensing unit in the trigger condition is “speech”, the value may be “*rain*”, indicating that any voice information containing “rain” is included; or the value may be “*[below] rain* "," means that any voice message containing "rain" or "rain" is included.
触发条件可以触发的一个或多个交互行为。在某些实施例中,可以设置交互行为之间的顺序,以按照设置的顺序执行多个交互行为。交互行为可以被配置为一个或多个可被机器人解析以执行的动作指令,动作指令还可以包括一个或多个参数。在某些实施例中,还可以配置所述一个或多个动作指令的执行顺序。该执行顺序可以包括但不限于随机执行一个或一组动作指令,以实现随机执行一个或多个动作;或者,按照预定步骤顺序执行多个动作指令。One or more interactions that the trigger condition can trigger. In some embodiments, the order between interactions can be set to perform multiple interactions in a set order. The interaction behavior can be configured as one or more action instructions that can be parsed by the robot for execution, and the action instructions can also include one or more parameters. In some embodiments, the order of execution of the one or more action instructions can also be configured. The execution order may include, but is not limited to, randomly executing one or a set of action instructions to effect random execution of one or more actions; or executing a plurality of action instructions in a predetermined sequence of steps.
机器人100的操作系统144及其他相关装置,可以解析交互行为的动作指令,使得机器人执行交互行为。例如,为了使机器人向前移动5米,动作指令可以是“move{“m”:5}”。机器人交互行为的控制装置148解析该动作指令,得到要执行的任务(移动)和任务参数(向前5米),向操作系统144传递任务和参数,操作系统144进一步处理使得移动装置(未示出)执行移动,移动装置可以包括足式、轮式以及履带式等。应当理解,也可以设置具体指令,比如移动装置的各个电机(或者类似部件)的参数。The operating system 144 of the robot 100 and other related devices can parse the action instructions of the interactive behavior, so that the robot performs the interactive behavior. For example, to move the robot forward by 5 meters, the action command can be "move{"m":5}". The robot interaction
在某些实施例中,交互行为的动作指令包括:用于执行其他控制条目而设置的到其他控制条目的链接,和/或用于从多个内容和/或多个参数中选取内容和/或参数而设置的到多个参数和/或多个内容的链接。每个控制条目可以具有唯一标识,动作指令可以引用控制条目的标识连接到该控制条目。动作指令链接到的内容可以是一组动作,机器人100可以根据其他因素执行一组动作中的动作,例如,可以预先配置机器人100的性格或性别等属性,这些属性可以存储在存储器102中,不同性别或者性格的机器人100对同一情况(或称为场景)的交互行为可以不同,机器人100可以根据设置的性格或性别等属性从一组动作中选择执行的动作,这些动作可以包括但不限于机器人100的肢体动作等。动作指令还可以链接到一个或一组内容,该内容可以包括但不限于语音聊天的内容、各种互联网信息等,例如,机器人100根据控制条目执行的动作为查询北京的天气,动作指令可以是一个查询天气的地址,机器人100到这一地址获取北京的天气,这一地址可以包括统一资源定位符(URL)、内存地址、数据库字段等。In some embodiments, the action instructions of the interactive behavior include: links to other control entries set for execution of other control entries, and/or for selecting content from a plurality of content and/or parameters and/or A link to multiple parameters and/or multiple content set by parameters or parameters. Each control entry may have a unique identification to which an action instruction may refer to the control entry. The content linked to the action instruction may be a set of actions, and the robot 100 may perform actions in a set of actions according to other factors. For example, attributes such as personality or gender of the robot 100 may be pre-configured, and the attributes may be stored in the memory 102, different The gender or personality of the robot 100 may be different for the interaction behavior of the same situation (or called a scene), and the robot 100 may select an executed action from a set of actions according to attributes such as a set personality or gender, and the actions may include, but are not limited to, a robot. 100 limb movements, etc. The action instruction may also be linked to one or a group of content, which may include, but is not limited to, the content of the voice chat, various Internet information, etc., for example, the action performed by the robot 100 according to the control item is to query the weather in Beijing, and the action instruction may be An address for querying the weather, the robot 100 obtains the weather in Beijing at this address, and the address may include a uniform resource locator (URL), a memory address, a database field, and the like.
机器人100的交互行为包括但不限于通过输出语音、调整姿态、输出图像或视频、与其他设备进行交互等。输出语音包括但不限于与用户聊天、播放音乐;调整姿态包括但不限于移动(例如,模仿人类步行等)、肢体摆动(例如,手臂、头部的摆动)、神态调整等;输出图像或视频包括但不限于在显示装置上显示图像或视频,图像可以是动态电子表情等,也可以是拍摄得到的图像,或者从网络中获取到的图像;与其他设备交互包括但不限于控制其他设备(例如调整空调设备的工作参数等)、向其他设备传输数据、与其他设备建立连接等。应当理解,交互行为并不限于上述列举的内容,机器人100对感知到的信息的反应均可被视为机器人100的交互行为。The interactive behavior of the robot 100 includes, but is not limited to, by outputting a voice, adjusting a gesture, outputting an image or video, interacting with other devices, and the like. Output speech includes, but is not limited to, chatting with a user, playing music; adjusting gestures including, but not limited to, moving (eg, mimicking human walking, etc.), limb swings (eg, arm, head swing), posture adjustment, etc.; outputting images or videos Including but not limited to displaying an image or video on a display device, the image may be a dynamic electronic expression, or the like, or an image obtained from a network, or an image obtained from a network;It includes but is not limited to controlling other devices (such as adjusting operating parameters of air conditioning devices, etc.), transmitting data to other devices, establishing connections with other devices, and the like. It should be understood that the interactive behavior is not limited to the above enumerated contents, and the reaction of the robot 100 to the perceived information can be regarded as the interactive behavior of the robot 100.
控制条目可以采用数据交换格式配置,当然也可以采用其他格式配置。数据交换格式包括但不限于XML、JSON或者YAML等。以JSON为例,需要实现:当用户说:“给我唱一首歌”,先往以中等速度0角度后退10cm然后开始唱一首歌,唱完歌以后10秒拍个照片发送给用户,然后0角度前行5CM。JSON数据格式的控制条目可以是如下内容:Control entries can be configured in a data exchange format, although other formats can be used. Data exchange formats include, but are not limited to, XML, JSON, or YAML. Take JSON as an example, you need to implement: When the user says, "Sing me a song," first go back to 10cm at a medium speed of 0 and then start singing a song. After singing the song, take a photo and send it to the user 10 seconds later. Then 0 angle forward 5CM. The control entry for the JSON data format can be as follows:
在上述的控制条目中,“ifs”部分为根据感知单元设置的触发条件,“ear”为感知单元的标识,“唱歌”为感知单元的取值。"trigger"部分为触发条件触发的交互行为,包括“move(移动)”、“song(唱歌)”和“take_pic(拍照)”三个交互行为,每个交互行为包括相应的动作指令。其中,“song(唱歌)”链接到“http://bpeer.com/i.mp3”,唱歌的内容从“http://bpeer.com/i.mp3”中获取,“gr”为动作的执行顺序。In the above control entry, the "ifs" part is a trigger condition set according to the sensing unit, "ear" is the identification of the sensing unit, and "singing" is the value of the sensing unit. The "trigger" part is the interactive behavior triggered by the trigger condition, including three interaction behaviors of "move", "song" and "take_pic", each of which includes a corresponding action instruction. Among them, "song" is linked to "http://bpeer.com/i.mp3", the content of singing is obtained from "http://bpeer.com/i.mp3", and "gr" is action Execution order.
在某些实施例中,多个控制条目可以存储为数据交换格式的文档,或者也可以存储在数据库中。在某些实施例中,机器人100还可以包括数据库系统,该数据库系统用以存储控制条目。数据库系统提供接口供一个或多个CPU 106从数据库中读取数据,以及向数据库系统写入数据。In some embodiments, multiple control entries may be stored as documents in a data exchange format, or may also be stored in a database. In some embodiments, the bot 100 can also include a database system for storing control entries. The database system provides an interface for one or
机器人交互行为的控制装置148可以根据控制条目控制机器人的交互行为,控制装置148获取机器人感知到的信息,根据感知到的信息、至少按照预先定义的感知单元生成感知数据,其中,感知数据包括感知单元的标识和取值;查找与生成的感知数据匹配的控制条目;如果查找到与生成的感知数据匹配的控制条目,使机器人执行查找到的控制条目中的交互行为。The
在某些实施例中,控制装置148也可以将机器人100感知到的信息发送出去,由远端服务器(未示出)根据感知到的信息和感知单元生成感知数据,并查找与生成的感知单元匹配的控制条目,然后将查找到的控制条目发送给控制装置148,控制装置148使机器人执行控制条目中的交互行为。可选地,可以生成感知到的信息的标识,以确定接收到的控制条目是否为针对发送的感知到的信息的控制条目。可选地,发送给控制装置148的可以是控制条目本身,也可以是控制条目的标识,或者控制条目配置的交互行为数据,或者其他使控制装置148确定控制条目配置的交互行为的信息。In some embodiments, the
在某些实施例中,控制装置148可以根据机器人100感知到的信息和感知单元生成感知数据,将生成的感知数据发送至远端服务器,远端服务器接收感知数据,查找与感知数据匹配的控制条目,将查找到的控制条目发送至机器人100,控制装置148使机器人100执行控制条目中的交互行为。In some embodiments, the
应当理解,控制装置148并不限于通过如上所述的方式控制机器人的交互行为,还可以是以上几种方式的组合或者其他方式。It should be understood that the
作为一个非限制性示例,行为的指令和行为控制参数可用JSON语言编写,但不限于此,其他方式也是可行的。非限制性的可包括:As a non-limiting example, the behavioral instruction and behavior control parameters can be written in the JSON language, but are not limited thereto, and other methods are also possible. Non-limiting ones may include:
1、让机器人说话1. Let the robot speak
行为名称为:audio_speak;The behavior name is: audio_speak;
行为控制参数可包括:text(要说的内容)、volume(说话的音量)等(例如,发声性别、或发声年龄等)Behavior control parameters can include: text (content to say), volume (volume of speech), etc. (eg, vocal gender, or vocal age, etc.)
JSON表示如下:JSON is expressed as follows:
“audio_speak”:{“text”:“你好吗”,“volume”:“50%”}"audio_speak": {"text": "How are you", "volume": "50%"}
非限制性地,“text”可包括转换字符,转换字符与参数对应。例如,“主人”的转换字符可被定义为“@master”,作为一个例子,包含转换字符的JSON表示如下:Without limitation, "text" may include a conversion character that corresponds to a parameter. For example, the "owner" conversion character can be defined as "@master". As an example, the JSON representation containing the conversion characters is as follows:
“audio_speak”:{“text”:“你好,@master”,“volume”:“50%”}"audio_speak": {"text": "Hello, @master", "volume": "50%"}
在执行“audio_speak”时,可将“@master”替换成“主人”的姓名。When "audio_speak" is executed, "@master" can be replaced with the name of "owner".
另外,在上述示例中“volume”被设置为百分比,机器人可根据“volume”的百分比值计算得到机器人的具体参数。作为另一个示例,“volume”也可以被表示为机器人的具体参数。In addition, in the above example, "volume" is set as a percentage, and the robot can calculate the specific parameters of the robot based on the percentage value of "volume". As another example, "volume" can also be represented as a specific parameter of the robot.
2、让机器人播放音乐2, let the robot play music
行为名称为:audio_sound_music;The behavior name is: audio_sound_music;
行为控制参数可包括:path(要播放音乐的路径、或文件名等)、volume(播放音乐的音量)等Behavior control parameters may include: path (path to play music, or file name, etc.), volume (volume of playing music), etc.
JSON表示如下:JSON is expressed as follows:
“audio_sound_music”:{“path”:“http//bpeer.com/happy.mp3”,“volume”:“50%”}"audio_sound_music": {"path": "http//bpeer.com/happy.mp3", "volume": "50%"}
3、让机器人播放提示音3, let the robot play the prompt tone
行为名称为:audio_sound_info;The behavior name is: audio_sound_info;
行为控制参数包括:name(要播放的提示音的名称)、volume(播放音量)等Behavior control parameters include: name (the name of the tone to be played), volume (play volume), etc.
JSON表示如下:JSON is expressed as follows:
“audio_sound_info”:{“name”:“warning”,“volume”:“normal”}"audio_sound_info": {"name": "warning", "volume": "normal"}
4、让机器人的头部运动4, let the robot's head movement
行为名称为:motion_head;The behavior name is: motion_head;
行为控制参数可包括:motor(执行运动的电机)、velocity(电机运动速度),angle(电机运动角度)等Behavior control parameters may include: motor (motor that performs motion), velocity (motor speed), angle (motor motion angle), etc.
JSON表示如下:JSON is expressed as follows:
“motion_head”:{“motor”:“1”,“velocity”:“1”,“angle”:“45”}"motion_head": {"motor": "1", "velocity": "1", "angle": "45"}
在上述示例中,“velocity”被表示为档位,机器人可根据该档位计算得到具体的“velocity”。实际上,“velocity”也可表示为机器人头部运动的具体参数。In the above example, "velocity" is represented as a gear position, and the robot can calculate a specific "velocity" based on the gear position. In fact, "velocity" can also be expressed as a specific parameter of the robot's head movement.
另外,上述示例中,“angle”被表示为电机的角度,实际上,“angle”可被表示为百分比等相对数据,例如,“angle”:“50%”,机器人可根据角度范围确定具体的参数,例如最大角度为180度,那么计算得到具体角度为90度,但不限于此。In addition, in the above example, "angle" is expressed as the angle of the motor. In fact, "angle" can be expressed as relative data such as percentage, for example, "angle": "50%", the robot can determine the specific range according to the angle range. The parameter, for example, the maximum angle is 180 degrees, then the calculated specific angle is 90 degrees, but is not limited thereto.
5、让机器人的脖子运动5, let the robot's neck movement
行为名称为:motion_neck;The behavior name is: motion_neck;
行为控制参数可包括:motor(执行运动的电机)、velocity(电机运动速度),angle(电机运动角度)等Behavior control parameters may include: motor (motor that performs motion), velocity (motor speed), angle (motor motion angle), etc.
JSON表示如下:JSON is expressed as follows:
“motion_neck”:{“motor”:“1”,“velocity”:“2”,“angle”:“60”}"motion_neck": {"motor": "1", "velocity": "2", "angle": "60"}
6、让机器人的肩膀运动6, let the robot's shoulder movement
行为名称为:motion_shoulder;The behavior name is: motion_shoulder;
行为控制参数可包括:motor(执行运动的电机)、velocity(电机运动速度),angle(电机运动角度)等Behavior control parameters may include: motor (motor that performs motion), velocity (motor speed), angle (motor motion angle), etc.
JSON表示如下:JSON is expressed as follows:
“motion_shoulder”:{“motor”:“1”,“velocity”:“3”,“angle”:“60”}"motion_shoulder": {"motor": "1", "velocity": "3", "angle": "60"}
7、让机器人的肘部运动7, let the robot's elbow movement
行为名称为:motion_elbow;The behavior name is: motion_elbow;
行为控制参数可包括:motor(执行运动的电机)、velocity(电机运动速度),angle(电机运动角度)等Behavior control parameters may include: motor (motor that performs motion), velocity (motor speed), angle (motor motion angle), etc.
JSON表示如下:JSON is expressed as follows:
“motion_elbow”:{“motor”:“1”,“velocity”:“2”,“angle”:“50”}"motion_elbow": {"motor": "1", "velocity": "2", "angle": "50"}
8、让机器人的腕部运动8, let the robot's wrist movement
行为名称为:motion_wrist;The behavior name is: motion_wrist;
行为控制参数可包括:motor(执行运动的电机)、velocity(电机运动速度),angle(电机运动角度)等Behavior control parameters may include: motor (motor that performs motion), velocity (motor speed), angle (motor motion angle), etc.
JSON表示如下:JSON is expressed as follows:
“motion_wrist”:{“motor”:“1”,“velocity”:“2”,“angle”:“50”}"motion_wrist": {"motor": "1", "velocity": "2", "angle": "50"}
9、让机器人的腰部运动9, let the robot's waist movement
行为名称为:motion_waist;The behavior name is: motion_waist;
行为控制参数可包括:motor(执行运动的电机)、velocity(电机运动速度),angle(电机运动角度)等Behavior control parameters may include: motor (motor that performs motion), velocity (motor speed), angle (motor motion angle), etc.
JSON表示如下:JSON is expressed as follows:
“motion_waist”:{“motor”:“1”,“velocity”:“2”,“angle”:“50”}"motion_waist": {"motor": "1", "velocity": "2", "angle": "50"}
10、让机器人的眼睛运动10, let the robot's eye movement
行为名称为:motion_eye;The behavior name is: motion_eye;
行为控制参数可包括:motor(执行运动的电机)、velocity(电机运动速度),angle(电机运动角度)等Behavior control parameters may include: motor (motor that performs motion), velocity (motor speed), angle (motor motion angle), etc.
JSON表示如下:JSON is expressed as follows:
“motion_eye”:{“motor”:“1”,“velocity”:“2”,“angle”:“50”}"motion_eye": {"motor": "1", "velocity": "2", "angle": "50"}
11、让机器人显示表情11, let the robot display expressions
行为名称为:display_emotion;The behavior name is: display_emotion;
行为控制参数可包括:content(有显示的表情内容)、velocity(显示速度)等Behavior control parameters can include: content (displayed emoticons), velocity (display speed), etc.
JSON表示如下:JSON is expressed as follows:
“display_emotion”:{“content”:“happy”,“velocity”:“3”}"display_emotion": {"content": "happy", "velocity": "3"}
12、让机器人拍照12, let the robot take pictures
行为名称为:program_photo;The behavior name is: program_photo;
行为控制参数可包括:flash(是否打开闪光灯)等Behavior control parameters can include: flash (whether the flash is turned on), etc.
JSON表示如下:JSON is expressed as follows:
“program_photo”:{“flash”:“1”}"program_photo": {"flash": "1"}
13、让机器人控制电视13, let the robot control the TV
行为名称为:control_tv;The behavior name is: control_tv;
行为控制参数可包括:state(例如open、close)等Behavior control parameters can include: state (eg open, close), etc.
JSON表示如下:JSON is expressed as follows:
“control_tv”:{“state”:“open”}"control_tv": {"state": "open"}
14、让机器人控制LED灯14, let the robot control the LED lights
行为名称为:control_led;The behavior name is: control_led;
行为控制参数可包括:state(例如open、close)、color等Behavior control parameters can include: state (eg open, close), color, etc.
JSON表示如下:JSON is expressed as follows:
“control_led”:{“state”:“open”,“color”:“yellow”}"control_led": {"state": "open", "color": "yellow"}
关于生成控制条目About generating control entries
在某些实施例中,可以根据感知单元设置触发条件,以及该触发条件触发的交互行为,得到控制条目,并将控制条目作为控制机器人100交互行为的数据。In some embodiments, the trigger condition may be set according to the sensing unit, and the interaction behavior triggered by the trigger condition, the control item is obtained, and the control item is used as data for controlling the interaction behavior of the robot 100.
图2说明根据本发明某些实施例的机器人的控制数据的生成方法的流程图,如图2所示,该方法包括:2 illustrates a flow chart of a method of generating control data for a robot in accordance with some embodiments of the present invention. As shown in FIG. 2, the method includes:
步骤S202,根据一个或多个预设的感知单元设置用于控制机器人交互行为的触发条件;Step S202, setting a trigger condition for controlling the interaction behavior of the robot according to one or more preset sensing units;
步骤S204,根据一个或多个预设的被设置为供机器人执行的交互行为,设置所述触发条件触发的交互行为;Step S204, setting an interaction behavior triggered by the trigger condition according to one or more preset interaction behaviors set for the robot to perform;
步骤S206,根据设置的触发条件和交互行为生成用于响应机器人感知到的信息来控制机器人交互行为的控制条目。Step S206, generating a control item for controlling the interaction behavior of the robot in response to the information perceived by the robot according to the set trigger condition and the interaction behavior.
在上述步骤S202中,可以从预设的感知单元中选取至少一个感知单元;设置选取的感知单元的属性,其中,感知单元的属性包括感知单元的取值;根据选取的感知单元及感知单元的属性设置用于控制机器人交互行为的触发条件。在某些实施例中,还设置多个感知单元之间的关系,感知单元之间的关系包括但不限于“与”、“或”、“非”等逻辑关系;上述步骤S202,可以根据选择的感知单元及感知单元的属性、以及感知单元之间的关系设置触发条件。In the above step S202, at least one sensing unit may be selected from the preset sensing unit; the attribute of the selected sensing unit is set, wherein the attribute of the sensing unit includes the value of the sensing unit; according to the selected sensing unit and the sensing unit The property settings are used to control the triggering conditions of the robot's interactive behavior. In some embodiments, the relationship between the plurality of sensing units is also set, and the relationship between the sensing units includes, but is not limited to, logical relationships such as “AND”, “OR”, “NO”, etc.; A trigger condition is set for the relationship between the sensing unit and the sensing unit and the relationship between the sensing units.
上述步骤S204中,可以从预设的被设置为供机器人执行的交互行为中选取至少一个交互行为;设置选取的交互行为的属性,其中,交互行为的属性包括交互行为的一个或多个可被机器人解析以执行的动作指令以及动作指令的参数;根据选取的交互行为及交互行为的属性设置触发条件触发的交互行为。在某些实施例中,还可以设置多个交互行为的执行顺序,交互行为的执行顺序包括但不限于随机执行一个或多个交互行为,或者按预定步骤执行多个交互行为。上述步骤S204,可以根据选取的交互行为及交互行为的属性、以及上述执行顺序设置触发条件触发的交互行为。In the above step S204, at least one interaction behavior may be selected from a preset interaction behavior set for the robot to perform; setting an attribute of the selected interaction behavior, wherein the attribute of the interaction behavior includes one or more interaction behaviors The robot parses the action instruction and the parameters of the action instruction; and sets the interaction behavior triggered by the trigger condition according to the selected interaction behavior and the attribute of the interaction behavior. In some embodiments, the execution order of the plurality of interaction behaviors may also be set, and the execution order of the interaction behaviors includes, but is not limited to, randomly performing one or more interaction behaviors, or performing a plurality of interaction behaviors according to predetermined steps. In the above step S204, the interaction behavior triggered by the trigger condition may be set according to the selected interaction behavior and the attribute of the interaction behavior and the execution order.
在某些实施例中,按照预定的数据表达方式来描述触发条件和触发条件触发的交互行为。可选地,可以使用数据交换格式根据触发条件和触发条件触发的交互行为生成控制条目。数据交换格式包括但不限于以下之一或任意组合:XML、JSON或者YAML。应当理解,还可以采用其他格式生成触发条件和触发条件触发的交互行为,包括本文件提交日尚未开发出的数据表达方式。In some embodiments, the triggering condition and the triggering condition triggered interaction behavior are described in terms of a predetermined data representation. Alternatively, the control entry may be generated using a data exchange format based on the interaction behavior triggered by the trigger condition and the trigger condition. Data exchange formats include, but are not limited to, one or any combination of the following: XML, JSON, or YAML. It should be understood that other formats may also be used to generate triggering conditions triggered by trigger conditions and trigger conditions, including data representations that have not yet been developed on the filing date of this document.
在某些实施例中,可以设置多个控制条目,并将多个控制条目存储为数据交换格式的文档。或者,多个控制条目也可以存储在数据库中。将多个控制条目存储为数据交换格式的文档时,相邻的控制条目之间可以用预定符号分隔,以区分不同的控制条目。存储控制条目的文档可以存储在机器人100的存储器102中,控制条目的文档也可以存储在远端服务器中。In some embodiments, multiple control entries can be set and multiple control entries stored as documents in a data exchange format. Alternatively, multiple control entries can also be stored in the database. When storing multiple control entries as documents in a data exchange format, adjacent control entries can be separated by a predetermined symbol to distinguish between different control entries. The document storing the control entry may be stored in the memory 102 of the robot 100, and the document of the control entry may also be stored in the remote server.
交互行为被配置为一个或多个动作指令。上述动作指令包括:用于执行其他控制条目而设置的到其他控制条目的链接,和/或用于从多个内容和/或多个参数中选取内容和/或参数而设置的到多个参数和/或多个内容的链接。例如,对于“查询天气”的动作指令,可以链接到提供天气信息的网页,从网页中获取要查询的城市的天气信息。查询到天气信息后,可以显示在机器人100的显示装置上,或者也可以通过语音播报天气信息。在某些实施例中,链接到一组动作的参数时,可以根据其他配置选择执行的动作的参数;同样,链接到多个内容时(例如聊天的多个语料),也可以根据其他配置选择呈现的内容。The interaction behavior is configured as one or more action instructions. The above action instructions include: links to other control entries set for executing other control entries, and/or multiple parameters set for selecting content and/or parameters from a plurality of content and/or parameters. And/or links to multiple content. For example, for the action command of "query weather", it is possible to link to a webpage providing weather information, and obtain weather information of the city to be queried from the webpage. After the weather information is queried, it may be displayed on the display device of the robot 100, or the weather information may be broadcasted by voice. In some embodiments, when linking to a set of action parameters, the actions performed may be selected according to other configurations.Parameters; Similarly, when linking to multiple content (such as multiple corpora of chats), you can also choose what to render based on other configurations.
还可以设置动作指令的执行顺序,其中,执行顺序包括:随机执行一个或多个动作指令,或者按预定步骤执行多个动作指令。执行顺序可以用符号进行标记,如果没有标记,可以按照描述动作的先后顺序。同一类型的动作可以作为一个整体,动作之间的先后顺序可以进行标记,例如“先向前移动5米,点头5次,然后向后退10米”,动作指令可以表达为[move:{gr:0,m:+5;gr:2,m:-10};head{gr:1,head:5}],“gr”表示动作的执行先后顺序,取值小的动作先执行。The execution order of the action instructions may also be set, wherein the execution sequence includes: randomly executing one or more action instructions, or executing a plurality of action instructions in predetermined steps. The order of execution can be marked with symbols. If there is no mark, it can be in the order in which the actions are described. The same type of action can be used as a whole, and the order of actions can be marked. For example, “move forward 5 meters, nod 5 times, then back 10 meters”, the action instruction can be expressed as [move:{gr: 0,m:+5;gr:2,m:-10};head{gr:1,head:5}], "gr" indicates the execution order of the action, and the action with a small value is executed first.
在某些实施例中,可以提供用于设置触发条件和交互行为的图形用户界面(GUI),图形用户界面提供设置的感知单元(例如,感知单元的名称、标识等)、可以设置的感知单元的取值、感知单元之间的逻辑关系,设置触发条件的用户可以选择感知单元、感知单元的取值以及感知单元的逻辑关系,选择设置触发条件的感知单元后,按照相应的格式生成触发条件。图形用户界面还可以提供设置的交互行为,可以是预先定义好的交互行为,在选择完交互行为之后,按照相应的格式生成交互行为。在某些实施例中,也可以直接编辑触发条件和交互行为,例如按照上述的数据交换格式、使用预先定义的感知单元以及交互行为的动作指令规范,编辑触发条件和触发条件触发的交互行为,得到控制条目。In some embodiments, a graphical user interface (GUI) can be provided for setting trigger conditions and interaction behaviors, the graphical user interface providing a set sensing unit (eg, the name of the sensing unit, the identification, etc.), a perceptible unit that can be set The value of the relationship between the sensing unit and the sensing unit. The user who sets the triggering condition can select the sensing unit, the value of the sensing unit, and the logical relationship of the sensing unit. After selecting the sensing unit that sets the triggering condition, the triggering condition is generated according to the corresponding format. . The graphical user interface can also provide set interaction behaviors, which can be pre-defined interaction behaviors, and after the interaction behavior is selected, the interaction behavior is generated according to the corresponding format. In some embodiments, the trigger condition and the interaction behavior may also be directly edited, for example, according to the data exchange format described above, the action instruction specification using the predefined sensing unit and the interaction behavior, and the interaction behavior triggered by the trigger condition and the trigger condition are edited. Get control entries.
在某些实施例中,可以从互联网抓取内容(例如网页等),对抓取的内容进行分析,得到用于设置控制条目的内容,根据这些内容设置触发条件和触发条件触发的交互行为。例如,从互联网中抓取到生病时拨打急救电话,可以根据感知单元设置“生病”的触发条件,并将该触发条件触发的交互行为设置为“拨打急救电话”。如果预先定义了“健康状况”这一感知单元,可以直接将感知单元的值设置为“生病”,构成的触发条件可以为{if(“health”:“sick”)}。机器人100可以根据感知到的数据判断用户的健康状况,确定健康状况是否为“生病”,例如,与用户进行语音聊天以了解用户的状态,以及检测用户的心率、体温等。在健康状况为“生病”时,机器人100生成的感知数据中包括可以{“health”:“sick”}。In some embodiments, content may be fetched from the Internet (eg, a web page, etc.), the captured content may be analyzed, content for setting control entries may be obtained, and triggering conditions triggered by trigger conditions and trigger conditions may be set according to the content. For example, when the emergency call is made from the Internet and the patient is ill, the trigger condition of “ill” can be set according to the sensing unit, and the interaction behavior triggered by the trigger condition is set to “call emergency call”. If the sensing unit of “health status” is predefined, the value of the sensing unit can be directly set to “ill”, and the triggering condition can be {if(“health”: “sick”)}. The robot 100 can determine the health status of the user based on the perceived data, determine whether the health condition is "ill", for example, perform a voice chat with the user to understand the state of the user, and detect the heart rate, body temperature, and the like of the user. When the health condition is "ill", the sensor 100 generates perceptual data including {"health": "sick"}.
关于使用控制条目控制机器人的交互行为About using control items to control robot interaction
将控制条目作为控制机器人交互行为的数据之后,可以根据控制条目来控制机器人的交互行为。After the control item is used as the data to control the interaction behavior of the robot, the interaction behavior of the robot can be controlled according to the control item.
图3说明根据本发明某些实施例的机器人交互行为的控制方法的流程图一,如图3所示,该方法包括:3 illustrates a flow chart 1 of a method of controlling robot interaction behavior, as shown in FIG. 3, in accordance with some embodiments of the present invention, including:
步骤S302,获取机器人感知到的数据;Step S302, acquiring data that is perceived by the robot;
步骤S304,根据感知到的信息、至少按照预先定义的感知单元生成感知数据,其中,感知数据包括感知单元的标识和取值;Step S304: Generate sensing data according to the perceptual information, at least according to a predefined sensing unit, where the sensing data includes an identifier and a value of the sensing unit.
步骤S306,在存储的多个控制条目中查找与生成的感知数据匹配的控制条目;Step S306, searching for a control entry that matches the generated sensing data among the stored plurality of control entries;
步骤S308,如果查找到与生成的感知数据匹配的控制条目,使机器人执行查找到的控制条目中的交互行为。Step S308, if the control item matching the generated sensing data is found, the robot is caused to perform the interactive behavior in the found control item.
在某些实施例中,机器人100通过网络与远端服务器(未示出)通信,机器人100感知至少一项数据,远端服务器从机器人100获取机器人感知到的信息,该获取包括远端服务器请求机器人100发送其感知到的信息,或者机器人感知到信息后,向远端服务器发送机器人100感知到的信息。机器人100可以周期性向远端服务器发送感知到的信息,或者在感知到的信息发生变化时向远端服务器发送感知到的信息,以降低远端服务器与机器人100之间的数据传输量。In some embodiments, the bot 100 communicates with a remote server (not shown) over a network, the bot 100 perceives at least one piece of data, and the remote server acquires information perceived by the bot from the bot 100, the acquisition including a remote server request The robot 100 transmits the information it perceives, or the robot senses the information, and transmits the information perceived by the robot 100 to the remote server. The robot 100 may periodically transmit the perceived information to the remote server or transmit the perceived information to the remote server when the perceived information changes to reduce the amount of data transmission between the remote server and the robot 100.
控制条目文档可以存储在远端服务器中,远端服务器包括一个或多个处理器,以及一个或多个保存在存储器中以执行图3所示的方法的模块、程序或指令集。远端服务器可以是单一的服务器,也可以是由多个服务器组成的服务器集群。应当理解,上述的程序或指令集并不局限于在一台服务器上运行,也可以在分布式的计算资源上运行。The control entry document can be stored in a remote server that includes one or more processors and one or more modules, programs, or sets of instructions that are stored in memory to perform the method illustrated in FIG. The remote server can be a single server or a server cluster consisting of multiple servers. It should be understood that the above described program or set of instructions is not limited to running on a single server, but can also be run on distributed computing resources.
在某些实施例中,可以将查找到的控制条目发送给机器人100,机器人100从控制条目中读取交互行为,并执行交互行为。或者,可以将查找到的控制条目中的交互行为的数据发送给机器人100。或者,也可以对控制条目中的交互行为的数据进行解析,得到机器人100可以执行的指令,将得到的指令发送至机器人100,机器人100执行该指令。应当理解,上述方式仅为举例说明。In some embodiments, the found control entry can be sent to the bot 100, which reads the interactive behavior from the control entry and performs the interactive behavior. Alternatively, data of the interactive behavior in the found control entry may be transmitted to the robot 100. Alternatively, the data of the interactive behavior in the control entry may be parsed to obtain an instruction that the robot 100 can execute, and the obtained command is transmitted to the robot 100, and the robot 100 executes the instruction. It should be understood that the above manner is merely illustrative.
图4说明根据本发明某些实施例的机器人交互行为的控制方法的流程图二,如图4所示,该方法包括:4 illustrates a flow chart 2 of a method of controlling robot interaction behavior, as shown in FIG. 4, according to some embodiments of the present invention, the method comprising:
步骤S402,接收机器人的感知数据,其中,感知数据根据机器人感知到的信息、至少按照预先定义的感知单元生成,感知数据包括感知单元的标识和取值;Step S402, receiving the sensing data of the robot, wherein the sensing data is generated according to the information perceived by the robot, at least according to a predefined sensing unit, and the sensing data includes the identifier and the value of the sensing unit;
步骤S404,在存储的多个控制条目中查找与机器人的感知数据匹配的控制条目;Step S404, searching for a control item matching the sensing data of the robot among the stored plurality of control items;
步骤S406,如果查找到与机器人的感知数据匹配的控制条目,使机器人执行查找到的控制条目中的交互行为。Step S406, if the control item matching the perceptual data of the robot is found, the robot is caused to perform the interaction behavior in the found control item.
如图4所示,机器人100感知至少一项信息,并根据感知到的信息和感知单元生成感知数据,将感知数据发送出去。在某些实施例中,机器人100将感知数据发送至远端服务器(未示出)。机器人100可以在生成感知数据之后发送感知数据,也可以在接收到远端服务器的请求后发送感知数据。As shown in FIG. 4, the robot 100 senses at least one piece of information, and generates sensing data based on the sensed information and the sensing unit, and transmits the sensing data. In some embodiments, the bot 100 sends the sensory data to a remote server (not shown). The robot 100 may transmit the sensing data after generating the sensing data, or may send the sensing data after receiving the request from the remote server.
在某些实施例中,远端服务器中存储控制条目的文档,例如,数据交换格式的文档,或者数据库等。当然,控制条目文档可以分布式存储在多个存储空间。远端服务器可以包括一个或多个处理器,以及一个或多个保存在存储器中以执行图3所示的方法的模块、程序或指令集。In some embodiments, the remote server stores documents that control entries, such as documents in a data exchange format, or a database, and the like. Of course, control entry documents can be distributed across multiple storage spaces. The remote server may include one or more processors and one or more modules, programs or sets of instructions stored in memory to perform the method illustrated in FIG.
图5说明根据本发明某些实施例的机器人交互行为的控制方法的流程图三,如图5所示,该方法包括:FIG. 5 illustrates a third flowchart of a method for controlling the interaction behavior of a robot according to some embodiments of the present invention. As shown in FIG. 5, the method includes:
步骤S502,感知至少一项信息;Step S502, sensing at least one piece of information;
步骤S504,根据感知到的信息、至少按照所述预先定义的感知单元生成感知数据,其中,感知数据包括感知单元的标识和取值;In step S504, the sensing data is generated according to the perceptual information, at least according to the predefined sensing unit, where the sensing data includes the identifier and the value of the sensing unit;
步骤S506,将生成的感知数据发送出去;Step S506, sending the generated sensing data;
步骤S508,接收与感知数据匹配的控制条目的信息;Step S508, receiving information of a control item that matches the sensing data;
步骤S510,根据控制条目的信息执行该控制条目配置的交互行为。Step S510, performing an interaction behavior of the control item configuration according to the information of the control item.
在某些实施例中,机器人100的交互行为控制装置148执行如图5所示的方法。机器人100感知至少一项信息,按照感知数据生成策略,根据感知单元生成感知数据。机器人100生成感知数据之后,将感知数据发送至远端服务器。远端服务器中存储控制条目的文档,在存储多个控制条目中查找与机器人的感知数据匹配的控制条目,如果查找到与机器人的感知数据匹配的控制条目,将该控制条目发送至机器人100。在某些实施例中,可以将控制条目中的交互行为的动作指令发送至机器人100。In some embodiments, the interactive
在某些实施例中,将生成的感知数据发送出去之前,还可以确定生成的感知数据的标识。确定生成的感知数据的标识后,将生成的感知数据及其标识发送出去。远端服务器在查找到与生成的感知数据匹配的控制条目后,将控制条目的信息和对应的感知数据的标识发送至控制装置148,控制条目的信息可以是控制条目本身、控制条目的标识、控制条条目配置的行为及其任意组合,但不限于此。控制装置接收控制条目的信息,并根据控制条目的信息中携带的感知数据的标识,判断接收到的控制条目的信息是否为与生成的感知数据匹配的控制条目的信息。In some embodiments, the identification of the generated sensory data may also be determined prior to transmitting the generated sensory data. After determining the identifier of the generated sensing data, the generated sensing data and its identifier are sent out. After the remote server finds the control entry that matches the generated sensing data, the information of the control entry and the identifier of the corresponding sensing data are sent to the
控制装置148可以根据控制条目的标识确定对应的控制条目,并执行控制条目中的交互行为。或者,控制装置148可以直接从远端服务器发送的控制条目中读取控制条目配置的交互行为,执行该交互行为。再者,如果远端服务器发送的是控制条目中配置的交互行为,控制装置148可以直接解析并执行该交互行为。
在某些实施例中,可以将机器人的感知数据与控制条目中的触发条件进行匹配,所述的匹配包括但不限于判断是否存在某一感知单元、比较感知单元的取值。In some embodiments, the sensory data of the robot may be matched with a trigger condition in the control entry, including but not limited to determining whether there is a certain sensing unit, the value of the comparison sensing unit.
在某些实施例中,当查找到多个与机器人的感知数据项匹配的触发条件时,可以确定机器人的感知数据与匹配到的多个触发条件的匹配程度,至少根据匹配程度选择与生成的感知数据匹配的控制条目。作为一个例子,对于感知数据中的语音文本,可以但不限于采用编辑距离确定匹配程度,编辑距离的取值越小两个文本越相似。语音文本还可以采用正则表达式来匹配。In some embodiments, when a plurality of trigger conditions matching the perceptual data items of the robot are found, the degree of matching between the perceptual data of the robot and the matched plurality of trigger conditions may be determined, at least according to the degree of matching. A control entry that senses data matching. As an example, for the speech text in the perceptual data, the degree of matching may be determined by using the editing distance, and the smaller the value of the editing distance, the more similar the two texts are. Speech text can also be matched using regular expressions.
在某些实施例中,还可以设置控制条目的优先级,在选择控制条目时可以参考控制条目的优先级。例如,可以将控制条目分类为核心控制条目、用户控制条目以及临时控制条目,核心控制条目为优先级最高的控制条目,其次是用户控制条目,最后是临时控制条目。在查找控制条目时,可以先从核心控制条目中查找与感知数据匹配的控制条目。如果在核心控制条目中未查找到与感知数据匹配的控制条目,可以在用户控制条目中查找与感知数据匹配的控制条目。如果在用户控制条目中未查找到与感知数据匹配的控制条目,可以在临时训练库中查找与感知数据匹配的控制条目。In some embodiments, the priority of the control entry can also be set, and the priority of the control entry can be referenced when selecting the control entry. For example, control entries can be classified into core control entries, user control entries, and temporary control entries, with the core control entry being the highest priority control entry, followed by the user control entry, and finally the temporary control entry. When looking up a control entry, you can first look up the control entry that matches the perceptual data from the core control entry. If a control entry that matches the perceptual data is not found in the core control entry, a control entry that matches the perceptual data can be found in the user control entry. If a control entry that matches the perceptual data is not found in the user control entry, a control entry that matches the perceptual data can be found in the temporary training library.
在某些实施例中,机器人100可以感知至少一项信息,根据感知到的信息和感知单元生成感知数据,并读取控制条目(包括但不限于从机器人100的存储器102读取),查找与生成的感知数据匹配的控制条目,如果查找到与生成的感知数据匹配的控制条目,机器人100执行查找到的控制条目中的交互行为。In some embodiments, the robot 100 can perceive at least one piece of information, generate perceptual data based on the perceptual information and sensing unit, and read control items (including but not limited to reading from the memory 102 of the robot 100), looking up and The generated control data matches the control entry, and if a control entry matching the generated perceptual data is found, the robot 100 performs the interactive behavior in the found control entry.
在某些实施例中,控制条目的文档可以存储机器人100的存储器102和远端服务器中。机器人100感知至少一项信息,根据感知到的信息和感知单元生成感知数据,从存储器102中读取控制条目,在读取的控制条目中查找与生成的感知数据匹配的控制条目。如果查找到与生成的感知数据匹配的控制条目,机器人100执行查找到的控制条目中的交互行为;如果在读取的控制条目中没有查找到与生成的感知数据匹配的控制条目,机器人100可以将生成的感知数据发送到远端服务器,远端服务器在存储的控制条目中查找与接收到的感知数据匹配的控制条目,如果查找到与接收到的感知数据匹配的控制条目,使机器人100执行该控制条目中的交互行为。远端服务器还可以将查找到的控制条目发送至机器人100,机器人100可以通过接口(未示出)接收控制条目,并存储接收到的控制条目。In some embodiments, the document of the control entry may be stored in the memory 102 and the remote server of the bot 100. The robot 100 perceives at least one piece of information, generates sensing data based on the sensed information and the sensing unit, reads the control item from the memory 102, and searches for the control item matching the generated sensing data in the read control item. If the control entry matching the generated perceptual data is found, the robot 100 performs the interaction behavior in the found control entry; if the control entry matching the generated perceptual data is not found in the read control entry, the robot 100 may Sending the generated sensing data to the remote server, the remote server searching for the control entry matching the received sensing data in the stored control entry, and if the control entry matching the received sensing data is found, causing the robot 100 to execute The interaction behavior in this control entry. The remote server can also find theThe control item is sent to the robot 100, which can receive the control entry through an interface (not shown) and store the received control entry.
如上所述,当查找到与感知数据匹配的控制条目时,使机器人100执行控制条目中的交互行为。当未查找到与感知数据匹配的控制条目时,可以不作交互行为,机器人100可以继续感知至少一项信息,感知何种信息可以根据预设的条件确定。在某些实施例中,当未查找到与感知数据匹配的控制条目时,可以进行语音回复或者导入互联网中的内容(例如,展示网页信息等)。当未查找到与感知数据匹配的控制条目时,可以判断感知数据是否与语音有关(例如,是否接收到用户的语音指令等),如果确定感知数据与语音有关,可以进行语音回复,或者根据语音内容在互联网中搜索相关内容,在机器人100的显示装置中呈现给用户。As described above, when a control entry that matches the perceptual data is found, the robot 100 is caused to perform an interactive behavior in the control entry. When the control item matching the perceptual data is not found, the interaction behavior may be omitted, and the robot 100 may continue to perceive at least one piece of information, and perceive what information can be determined according to the preset condition. In some embodiments, when a control entry that matches the perceptual data is not found, a voice reply can be made or imported into the Internet (eg, displaying web page information, etc.). When the control item matching the sensing data is not found, it may be determined whether the sensing data is related to the voice (for example, whether the user's voice instruction is received, etc.), and if the sensing data is determined to be related to the voice, the voice response may be performed, or according to the voice. The content is searched for relevant content in the Internet and presented to the user in the display device of the robot 100.
在某些实施例中,可以根据机器人与用户的交互行为设置控制条目。当未查找到与机器人100的感知数据匹配的控制条目时,机器人100可以与用户进行语音聊天,在聊天过程中,机器人100分析用户的需求和意图,得到情景和该情境下机器人的交互行为,根据情景、机器人的交互行为、按照感知单元生成控制条目。例如,用户生病时,对机器人说“我生病了”,机器人100的控制条目中没有在用户生病时的交互行为,此时机器人100可以和用户进行语音交互,比如询问用户“我不清楚需要做什么”,用户可以说“帮我拨打我的私人医生的电话吧,电话号码是….”,机器人100可以拨打电话。此外,在这种情况下,机器人100分析得出用户“生病”时需要联系医生,根据分析得出的结果,机器人100可以生成控制条目,例如,触发条件为[if(health:sick)],触发条件触发的交互行为为[call{number:“//doctor_number.php”]。In some embodiments, the control entries can be set based on the interaction behavior of the robot with the user. When the control item matching the sensing data of the robot 100 is not found, the robot 100 can perform a voice chat with the user. During the chat, the robot 100 analyzes the user's needs and intentions, and obtains the interaction behavior of the scene and the robot in the situation. According to the situation, the interaction behavior of the robot, the control item is generated according to the sensing unit. For example, when the user is sick, the robot says "I am sick", and the control item of the robot 100 does not have an interaction behavior when the user is sick. At this time, the robot 100 can perform a voice interaction with the user, such as asking the user "I don't know what needs to be done. What, the user can say "Help me call my private doctor, the phone number is ....", the robot 100 can make a call. In addition, in this case, the robot 100 needs to contact the doctor when analyzing that the user is "ill", and according to the result of the analysis, the robot 100 can generate a control item, for example, the trigger condition is [if(health:sick)], The interaction behavior triggered by the trigger condition is [call{number:"//doctor_number.php"].
下面对某些实施例的机器人的控制数据的生成装置的结构进行描述。由于机器人的控制数据的生成装置解决问题的原理与机器人交互行为的控制方法相似,因此机器人的控制数据的生成装置的实施可以参见机器人的控制数据的生成方法的实施,重复之处不再赘述。以下所使用的,术语“单元”或者“模块”可以实现预定功能的软件和/或硬件的组合。尽管以下实施例所描述的装置较佳地以软件来实现,但是硬件,或者软件和硬件的组合的实现也是可能并被构想的。The structure of the apparatus for generating control data of the robot of some embodiments will be described below. Since the principle of solving the problem by the generating device of the control data of the robot is similar to the control method of the interactive behavior of the robot, the implementation of the generating device for controlling the data of the robot can be referred to the implementation of the method for generating the control data of the robot, and the repeated description will not be repeated. As used hereinafter, the term "unit" or "module" may implement a combination of software and/or hardware of a predetermined function. Although the apparatus described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware, is also possible and contemplated.
图6说明根据本发明某些实施例的机器人的控制数据的生成装置的结构框图,如图6所示,该装置包括:6 is a block diagram showing the structure of a control device for generating control data of a robot according to some embodiments of the present invention. As shown in FIG. 6, the device includes:
触发条件设置模块602,用于根据一个或多个预设的感知单元设置用于控制机器人交互行为的触发条件,其中,感知单元被设置为控制机器人交互行为的最小单元;The trigger
交互行为设置模块604,与触发条件设置模块602相连,用于根据一个或多个预设的被设置为供机器人执行的交互行为,设置所述触发条件触发的交互行为;The interaction
生成模块606,与交互行为设置模块604相连,用于根据设置的触发条件和交互行为生成用于响应机器人感知到的信息来控制机器人交互行为的控制条目。The
图7说明根据本发明某些实施例的机器人交互行为的控制装置的结构框图一,如图7所示,该装置包括:获取模块702,用于获取机器人感知到的信息;生成模块704,与获取模块702相连,用于根据感知到的信息、至少按照预先定义的感知单元生成感知数据;查找模块706,与生成模块704相连,用于查找与生成的感知数据匹配的控制条目;执行模块708,与查找模块706相连,用于当查找到与生成的感知数据匹配的控制条目时,使机器人执行查找到的控制条目中的行为。FIG. 7 is a block diagram showing the structure of a control apparatus for robot interaction behavior according to some embodiments of the present invention. As shown in FIG. 7, the apparatus includes: an acquisition module 702, configured to acquire information perceived by a robot; and a generation module 704, The obtaining module 702 is connected to generate sensing data according to the perceptual information at least according to the predefined sensing unit. The searching
图8说明根据本发明某些实施例的机器人交互行为的控制装置的结构框图二,如图8所示,该装置包括:感知模块802,用于感知至少一项信息;生成模块804,与感知模块802相连,用于根据感知到的信息、至少按照预先定义的感知单元生成感知数据;发送模块806,与生成模块804相连,用于将生成的感知数据发送出去;接收模块808,与发送模块806相连,用于接收与感知数据匹配的控制条目的信息;执行模块810,与接收模块808相连,用于根据所述控制条目的信息执行该控制条目中的交互行为。8 is a block diagram showing the structure of a control apparatus for robot interaction behavior according to some embodiments of the present invention. As shown in FIG. 8, the apparatus includes: a
图9说明根据本发明某些实施例的机器人交互行为的控制装置的结构框图三,如图9所示,该装置包括:接收模块902,用于接收机器人的感知数据;查找模块904,与接收模块902相连,用于查找与所述机器人的感知数据匹配的控制条目;执行模块906,与查找模块904相连,用于当查找到与所述机器人的感知数据对应的控制条目,使所述机器人执行查找到的控制条目中触发条件触发的行为。FIG. 9 is a block diagram showing the structure of a control apparatus for robot interaction behavior according to some embodiments of the present invention. As shown in FIG. 9, the apparatus includes: a receiving
图10说明根据本发明某些实施例的机器人交互行为的控制装置的结构框图四,如图10所示,该装置包括:控制条目文档1002,用于提供包含多个控制条目的控制条目文档,其中,每个控制条目包含触发条件和该触发条件触发的行为,每个触发条件由至少一个预先定义的感知单元构成;10 illustrates a structural block diagram of a control apparatus for robot interaction behavior in accordance with some embodiments of the present invention. As shown in FIG. 10, the apparatus includes a control entry document 1002 for providing a control entry document including a plurality of control entries. Wherein each control item includes a trigger condition and an action triggered by the trigger condition, each trigger condition being composed of at least one predefined sensing unit;
匹配模块1004,与控制条目文档1002相连,用于将机器人的感知数据与控制条目进行匹配,以确定是否存在与所述机器人的感知数据匹配的控制条目,其中,所述感知数据根据机器人感知到的信息、至少按照预先定义的感知单元生成。The
显然,本领域的技术人员应该明白,上述的本发明实施例的各模块或各步骤可以用通用的计算装置来实现,它们可以集中在单个的计算装置上,或者分布在多个计算装置所组成的网络上,可选地,它们可以用计算装置可执行的程序代码来实现,从而,可以将它们存储在存储装置中由计算装置来执行,并且在某些情况下,可以以不同于此处的顺序执行所示出或描述的步骤,或者将它们分别制作成各个集成电路模块,或者将它们中的多个模块或步骤制作成单个集成电路模块来实现。这样,本发明实施例不限制于任何特定的硬件和软件结合。It will be apparent to those skilled in the art that the various modules or steps of the above-described embodiments of the present invention may be implemented by a general-purpose computing device, which may be centralized on a single computing device or distributed across multiple computing devices.Alternatively, they may be implemented by program code executable by the computing device such that they may be stored in the storage device by the computing device and, in some cases, may be different The steps shown or described herein are performed sequentially, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps thereof are fabricated as a single integrated circuit module. Thus, embodiments of the invention are not limited to any specific combination of hardware and software.
以上所述仅为本发明的优选实施例而已,并不用于限制本发明,对于本领域的技术人员来说,本发明实施例可以有各种更改和变化。凡在本发明的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。The above description is only the preferred embodiment of the present invention, and is not intended to limit the present invention, and various changes and modifications may be made to the embodiments of the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510364661.7 | 2015-06-26 | ||
| CN201510363346.2ACN106325113B (en) | 2015-06-26 | 2015-06-26 | Robot controls engine and system |
| CN201510363348.1 | 2015-06-26 | ||
| CN201510364661.7ACN106325228B (en) | 2015-06-26 | 2015-06-26 | Method and device for generating control data of robot |
| CN201510363346.2 | 2015-06-26 | ||
| CN201510363348.1ACN106325065A (en) | 2015-06-26 | 2015-06-26 | Robot interactive behavior control method, device and robot |
| Publication Number | Publication Date |
|---|---|
| WO2016206643A1true WO2016206643A1 (en) | 2016-12-29 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2016/087258CeasedWO2016206643A1 (en) | 2015-06-26 | 2016-06-27 | Method and device for controlling interactive behavior of robot and robot thereof |
| PCT/CN2016/087257CeasedWO2016206642A1 (en) | 2015-06-26 | 2016-06-27 | Method and apparatus for generating control data of robot |
| PCT/CN2016/087261CeasedWO2016206646A1 (en) | 2015-06-26 | 2016-06-27 | Method and system for urging machine device to generate action |
| PCT/CN2016/087262CeasedWO2016206647A1 (en) | 2015-06-26 | 2016-06-27 | System for controlling machine apparatus to generate action |
| PCT/CN2016/087259CeasedWO2016206644A1 (en) | 2015-06-26 | 2016-06-27 | Robot control engine and system |
| PCT/CN2016/087260CeasedWO2016206645A1 (en) | 2015-06-26 | 2016-06-27 | Method and apparatus for loading control data into machine device |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2016/087257CeasedWO2016206642A1 (en) | 2015-06-26 | 2016-06-27 | Method and apparatus for generating control data of robot |
| PCT/CN2016/087261CeasedWO2016206646A1 (en) | 2015-06-26 | 2016-06-27 | Method and system for urging machine device to generate action |
| PCT/CN2016/087262CeasedWO2016206647A1 (en) | 2015-06-26 | 2016-06-27 | System for controlling machine apparatus to generate action |
| PCT/CN2016/087259CeasedWO2016206644A1 (en) | 2015-06-26 | 2016-06-27 | Robot control engine and system |
| PCT/CN2016/087260CeasedWO2016206645A1 (en) | 2015-06-26 | 2016-06-27 | Method and apparatus for loading control data into machine device |
| Country | Link |
|---|---|
| WO (6) | WO2016206643A1 (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108388399A (en)* | 2018-01-12 | 2018-08-10 | 北京光年无限科技有限公司 | The method of state management and system of virtual idol |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11220008B2 (en)* | 2017-07-18 | 2022-01-11 | Panasonic Intellectual Property Management Co., Ltd. | Apparatus, method, non-transitory computer-readable recording medium storing program, and robot |
| JP7188950B2 (en)* | 2018-09-20 | 2022-12-13 | 株式会社Screenホールディングス | Data processing method and data processing program |
| TWI735168B (en)* | 2020-02-27 | 2021-08-01 | 東元電機股份有限公司 | Voice robot |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101618280A (en)* | 2009-06-30 | 2010-01-06 | 哈尔滨工业大学 | Humanoid-head robot device with human-computer interaction function and behavior control method thereof |
| WO2011058530A1 (en)* | 2009-11-16 | 2011-05-19 | Koninklijke Philips Electronics, N.V. | Human-robot shared control for endoscopic assistant robot |
| CN102446428A (en)* | 2010-09-27 | 2012-05-09 | 北京紫光优蓝机器人技术有限公司 | Robot-based interactive learning system and interactive method thereof |
| CN103399637A (en)* | 2013-07-31 | 2013-11-20 | 西北师范大学 | Man-computer interaction method for intelligent human skeleton tracking control robot on basis of kinect |
| CN104640677A (en)* | 2012-06-21 | 2015-05-20 | 睿信科机器人有限公司 | Train and operate industrial robots |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001353678A (en)* | 2000-06-12 | 2001-12-25 | Sony Corp | Authoring system and method and storage medium |
| JP4108342B2 (en)* | 2001-01-30 | 2008-06-25 | 日本電気株式会社 | Robot, robot control system, and program thereof |
| US7089184B2 (en)* | 2001-03-22 | 2006-08-08 | Nurv Center Technologies, Inc. | Speech recognition for recognizing speaker-independent, continuous speech |
| US6957215B2 (en)* | 2001-12-10 | 2005-10-18 | Hywire Ltd. | Multi-dimensional associative search engine |
| EP1685680B1 (en)* | 2003-11-20 | 2012-01-04 | Panasonic Corporation | Association control apparatus, association control method and service association system |
| JP2005193331A (en)* | 2004-01-06 | 2005-07-21 | Sony Corp | Robot device and its emotional expression method |
| WO2006093394A1 (en)* | 2005-03-04 | 2006-09-08 | Chutnoon Inc. | Server, method and system for providing information search service by using web page segmented into several information blocks |
| JP2007044825A (en)* | 2005-08-10 | 2007-02-22 | Toshiba Corp | Action management device, action management method, and action management program |
| US7945441B2 (en)* | 2007-08-07 | 2011-05-17 | Microsoft Corporation | Quantized feature index trajectory |
| EP2321817A4 (en)* | 2008-06-27 | 2013-04-17 | Yujin Robot Co Ltd | Interactive learning system using robot and method of operating the same in child education |
| FR2946160B1 (en)* | 2009-05-26 | 2014-05-09 | Aldebaran Robotics | SYSTEM AND METHOD FOR EDIT AND ORDER BEHAVIOR OF MOBILE ROBOT. |
| US20110213659A1 (en)* | 2010-02-26 | 2011-09-01 | Marcus Fontoura | System and Method for Automatic Matching of Contracts in an Inverted Index to Impression Opportunities Using Complex Predicates and Confidence Threshold Values |
| FR2963132A1 (en)* | 2010-07-23 | 2012-01-27 | Aldebaran Robotics | HUMANOID ROBOT HAVING A NATURAL DIALOGUE INTERFACE, METHOD OF USING AND PROGRAMMING THE SAME |
| KR20120047577A (en)* | 2010-11-04 | 2012-05-14 | 주식회사 케이티 | Apparatus and method for providing robot interaction services using interactive behavior model |
| JP2015501025A (en)* | 2011-10-05 | 2015-01-08 | オプテオン コーポレーション | Method, apparatus and system for monitoring and / or controlling a dynamic environment |
| WO2014050192A1 (en)* | 2012-09-27 | 2014-04-03 | オムロン株式会社 | Device management apparatus and device search method |
| CN103324100B (en)* | 2013-05-02 | 2016-08-31 | 郭海锋 | A kind of emotion on-vehicle machines people of information-driven |
| CN103729476A (en)* | 2014-01-26 | 2014-04-16 | 王玉娇 | Method and system for correlating contents according to environmental state |
| CN103793536B (en)* | 2014-03-03 | 2017-04-26 | 陈念生 | Intelligent platform obtaining method and device |
| CN105511608B (en)* | 2015-11-30 | 2018-12-25 | 北京光年无限科技有限公司 | Exchange method and device, intelligent robot based on intelligent robot |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101618280A (en)* | 2009-06-30 | 2010-01-06 | 哈尔滨工业大学 | Humanoid-head robot device with human-computer interaction function and behavior control method thereof |
| WO2011058530A1 (en)* | 2009-11-16 | 2011-05-19 | Koninklijke Philips Electronics, N.V. | Human-robot shared control for endoscopic assistant robot |
| CN102446428A (en)* | 2010-09-27 | 2012-05-09 | 北京紫光优蓝机器人技术有限公司 | Robot-based interactive learning system and interactive method thereof |
| CN104640677A (en)* | 2012-06-21 | 2015-05-20 | 睿信科机器人有限公司 | Train and operate industrial robots |
| CN103399637A (en)* | 2013-07-31 | 2013-11-20 | 西北师范大学 | Man-computer interaction method for intelligent human skeleton tracking control robot on basis of kinect |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108388399A (en)* | 2018-01-12 | 2018-08-10 | 北京光年无限科技有限公司 | The method of state management and system of virtual idol |
| CN108388399B (en)* | 2018-01-12 | 2021-04-06 | 北京光年无限科技有限公司 | Virtual idol state management method and system |
| Publication number | Publication date |
|---|---|
| WO2016206646A1 (en) | 2016-12-29 |
| WO2016206645A1 (en) | 2016-12-29 |
| WO2016206647A1 (en) | 2016-12-29 |
| WO2016206644A1 (en) | 2016-12-29 |
| WO2016206642A1 (en) | 2016-12-29 |
| Publication | Publication Date | Title |
|---|---|---|
| JP6816925B2 (en) | Data processing method and equipment for childcare robots | |
| CN106325228B (en) | Method and device for generating control data of robot | |
| US11010601B2 (en) | Intelligent assistant device communicating non-verbal cues | |
| EP3866160B1 (en) | Electronic device and control method thereof | |
| JP2022537011A (en) | AI-BASED VOICE-DRIVEN ANIMATION METHOD AND APPARATUS, DEVICE AND COMPUTER PROGRAM | |
| US11367443B2 (en) | Electronic device and method for controlling electronic device | |
| KR102740847B1 (en) | Method for processing user input and electronic device supporting the same | |
| KR20160034243A (en) | Apparatus and methods for providing a persistent companion device | |
| US12047660B2 (en) | Information processing apparatus, information processing method, and program | |
| CN111816168B (en) | A model training method, a voice playback method, a device and a storage medium | |
| CN106325065A (en) | Robot interactive behavior control method, device and robot | |
| US12315057B2 (en) | Avatar facial expressions based on semantical context | |
| WO2016206643A1 (en) | Method and device for controlling interactive behavior of robot and robot thereof | |
| CN110152314A (en) | Session output system, session output server, session output method, and storage medium | |
| JP2023120130A (en) | Conversation-type ai platform using extraction question response | |
| US20130159400A1 (en) | User device, server, and operating conditions setting system | |
| US12346994B2 (en) | Method and system for virtual intelligence user interaction | |
| US20200234187A1 (en) | Information processing apparatus, information processing method, and program | |
| WO2020153146A1 (en) | Information processing device and information processing method | |
| JP2024159687A (en) | Agent System | |
| JP2018075657A (en) | GENERATION PROGRAM, GENERATION DEVICE, CONTROL PROGRAM, CONTROL METHOD, ROBOT DEVICE, AND CALL SYSTEM | |
| KR20200077936A (en) | Electronic device for providing reaction response based on user status and operating method thereof | |
| WO2023006033A1 (en) | Speech interaction method, electronic device, and medium | |
| WO2020087534A1 (en) | Generating response in conversation | |
| US11731262B2 (en) | Robot and method for operating the same |
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application | Ref document number:16813759 Country of ref document:EP Kind code of ref document:A1 | |
| NENP | Non-entry into the national phase | Ref country code:DE | |
| 122 | Ep: pct application non-entry in european phase | Ref document number:16813759 Country of ref document:EP Kind code of ref document:A1 |