Movatterモバイル変換


[0]ホーム

URL:


WO2020177592A1 - Painting question answering method and device, painting question answering system, and readable storage medium - Google Patents

Painting question answering method and device, painting question answering system, and readable storage medium
Download PDF

Info

Publication number
WO2020177592A1
WO2020177592A1PCT/CN2020/076780CN2020076780WWO2020177592A1WO 2020177592 A1WO2020177592 A1WO 2020177592A1CN 2020076780 WCN2020076780 WCN 2020076780WWO 2020177592 A1WO2020177592 A1WO 2020177592A1
Authority
WO
WIPO (PCT)
Prior art keywords
painting
text information
answer
question
display terminal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2020/076780
Other languages
French (fr)
Chinese (zh)
Inventor
贾红红
胡风硕
徐楚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BOE Technology Group Co Ltd
Original Assignee
BOE Technology Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BOE Technology Group Co LtdfiledCriticalBOE Technology Group Co Ltd
Publication of WO2020177592A1publicationCriticalpatent/WO2020177592A1/en
Anticipated expirationlegal-statusCritical
Ceasedlegal-statusCriticalCurrent

Links

Images

Classifications

Definitions

Landscapes

Abstract

The present disclosure provides a painting question answering method and device, a painting question answering system, and a readable storage medium. The painting question answering method comprises: obtaining text information from a display terminal, and obtaining a current conversation status of the display terminal; performing semantic parsing on the text information so as to obtain a current intention of a user; determining a target conversation status according to the current conversation status and the current intention; and obtaining, according to the target conversation status, answer data corresponding to the text information.

Description

Translated fromChinese
画作问答方法及装置、画作问答系统、可读存储介质Painting question and answer method and device, painting question and answer system, and readable storage medium

本申请要求于2019年3月5日递交的中国专利申请第201910163293.8号的优先权,在此全文引用上述中国专利申请公开的内容以作为本申请的一部分。This application claims the priority of the Chinese patent application No. 201910163293.8 filed on March 5, 2019, and the contents of the above-mentioned Chinese patent application are quoted here in full as a part of this application.

技术领域Technical field

本公开的实施例涉及一种画作问答方法及装置、画作问答系统、可读存储介质。The embodiments of the present disclosure relate to a painting question answering method and device, a painting question answering system, and a readable storage medium.

背景技术Background technique

目前,在线平台,如在线艺术画廊,作为观赏艺术画作以及分享艺术创作的平台受到大众的广泛关注。用户可以通过在线平台欣赏艺术画作,并可以对艺术画作执行查询、交易等操作。Currently, online platforms, such as online art galleries, have received widespread public attention as platforms for viewing art paintings and sharing artistic creations. Users can enjoy art paintings through the online platform, and can perform operations such as inquiries and transactions on art paintings.

发明内容Summary of the invention

本公开至少一实施例提供一种画作问答方法,包括:获取来自显示终端的文本信息,以及获取所述显示终端的当前对话状态;对所述文本信息进行语义理解以获取用户的当前意图;根据所述当前对话状态和所述当前意图确定目标对话状态;和根据所述目标对话状态获取所述文本信息对应的回答数据。At least one embodiment of the present disclosure provides a painting question answering method, including: acquiring text information from a display terminal and acquiring the current dialogue state of the display terminal; performing semantic understanding on the text information to acquire the current intention of the user; The current dialogue state and the current intention determine a target dialogue state; and the answer data corresponding to the text information is obtained according to the target dialogue state.

例如,在本公开至少一实施例提供的画作问答方法中,所述回答数据包括画作数据或者用于提取所述画作数据的提取信息。For example, in the painting question answering method provided by at least one embodiment of the present disclosure, the answer data includes painting data or extraction information used to extract the painting data.

例如,在本公开至少一实施例提供的画作问答方法中,对所述文本信息进行语义理解以获取所述用户的当前意图,包括:识别所述文本信息的命名实体;根据所述命名实体确定所述命名实体对应的待识别向量;和基于所述待识别向量,将满足要求的标准特征向量的意图确定为所述文本信息的当前意图。For example, in the painting question answering method provided by at least one embodiment of the present disclosure, the semantic understanding of the text information to obtain the current intention of the user includes: identifying the named entity of the text information; determining according to the named entity The vector to be recognized corresponding to the named entity; and based on the vector to be recognized, the intent of the standard feature vector that meets the requirements is determined as the current intent of the text information.

例如,在本公开至少一实施例提供的画作问答方法中,识别所述文本信 息的命名实体包括:通过命名实体识别模型识别所述文本信息的命名实体。For example, in the painting question answering method provided by at least one embodiment of the present disclosure, identifying the named entity of the text information includes: identifying the named entity of the text information through a named entity recognition model.

例如,在本公开至少一实施例提供的画作问答方法中,根据所述命名实体确定所述命名实体对应的待识别向量包括:通过深度学习模型,根据所述命名实体确定所述命名实体对应的待识别向量。For example, in the painting question answering method provided by at least one embodiment of the present disclosure, determining the vector to be recognized corresponding to the named entity according to the named entity includes: determining the vector corresponding to the named entity according to the named entity through a deep learning model The vector to be recognized.

例如,在本公开至少一实施例提供的画作问答方法中,基于所述待识别向量,将满足要求的标准特征向量的意图确定为所述文本信息的当前意图,包括:将与所述待识别向量的相似度最大的标准特征向量的意图确定为所述文本信息的当前意图。For example, in the painting question answering method provided by at least one embodiment of the present disclosure, based on the to-be-recognized vector, determining the intent of the standard feature vector that meets the requirements as the current intent of the text information includes: The intent of the standard feature vector with the largest similarity of the vectors is determined as the current intent of the text information.

例如,在本公开至少一实施例提供的画作问答方法中,所述文本信息为所述用户直接输入的文本内容,或者为识别所述用户输入的语音信息以后得到的文本内容。For example, in the painting question answering method provided by at least one embodiment of the present disclosure, the text information is text content directly input by the user, or text content obtained after recognizing the voice information input by the user.

例如,在本公开至少一实施例提供的画作问答方法中,获取来自所述显示终端的文本信息,包括:接收来自所述显示终端的请求数据,解析所述请求数据以获取所述文本信息。For example, in the painting question answering method provided by at least one embodiment of the present disclosure, obtaining text information from the display terminal includes: receiving request data from the display terminal, and parsing the request data to obtain the text information.

例如,本公开至少一实施例提供的画作问答方法还包括:将所述回答数据发送至所述显示终端。For example, the painting question answering method provided by at least one embodiment of the present disclosure further includes: sending the answer data to the display terminal.

例如,本公开至少一实施例提供的画作问答方法还包括:识别来自所述显示终端的语音信息,以得到所述文本信息。For example, the painting question answering method provided by at least one embodiment of the present disclosure further includes: recognizing voice information from the display terminal to obtain the text information.

本公开至少一实施例还提供一种画作问答装置,包括:文本信息获取电路,被配置为获取来自显示终端的文本信息,以及获取所述显示终端的当前对话状态;当前意图获取电路,被配置为对所述文本信息进行语义理解以获取用户的当前意图;目标状态确定电路,被配置为根据所述当前对话状态和所述当前意图确定目标对话状态;回答数据获取电路,被配置为根据所述目标对话状态获取所述文本信息对应的回答数据。At least one embodiment of the present disclosure also provides a painting question and answer device, including: a text information acquisition circuit configured to acquire text information from a display terminal and to acquire the current dialogue state of the display terminal; and a current intention acquisition circuit configured to In order to perform semantic understanding of the text information to obtain the current intention of the user; the target state determination circuit is configured to determine the target dialogue state according to the current dialogue state and the current intention; the answer data acquisition circuit is configured to The target dialogue state acquires answer data corresponding to the text information.

例如,在本公开至少一实施例提供的画作问答装置中,所述当前意图获取电路包括:命名实体识别电路,被配置为识别所述文本信息的命名实体;识别向量确定电路,被配置为根据所述命名实体确定所述命名实体对应的待识别向量;当前意图确定电路,被配置为基于所述待识别向量,将满足要求的标准特征向量的意图确定为所述文本信息的当前意图。For example, in the painting question and answer device provided by at least one embodiment of the present disclosure, the current intention acquisition circuit includes: a named entity recognition circuit configured to recognize a named entity of the text information; and a recognition vector determination circuit configured according to The named entity determines the vector to be recognized corresponding to the named entity; the current intent determination circuit is configured to determine the intent of the standard feature vector that meets the requirements as the current intent of the text information based on the vector to be recognized.

本公开至少一实施例还提供一种画作问答系统,包括:显示终端和问答 服务器。所述显示终端被配置为将请求数据发送给所述问答服务器;所述问答服务器被配置为基于所述请求数据获取来自所述显示终端的文本信息,以及获取所述显示终端的当前对话状态,并对所述文本信息进行语义理解以获取用户的当前意图;根据所述当前对话状态和所述当前意图确定目标对话状态;以及根据所述目标对话状态获取所述文本信息对应的回答数据;所述显示终端还被配置为接收所述回答数据,并显示基于所述回答数据的画作数据。At least one embodiment of the present disclosure also provides a painting question answering system, which includes a display terminal and a question answering server. The display terminal is configured to send request data to the question and answer server; the question and answer server is configured to obtain text information from the display terminal based on the request data, and to obtain the current dialogue state of the display terminal, And perform semantic understanding of the text information to obtain the current intention of the user; determine the target dialogue state according to the current dialogue state and the current intention; and obtain the answer data corresponding to the text information according to the target dialogue state; The display terminal is also configured to receive the answer data and display painting data based on the answer data.

例如,在本公开至少一实施例提供的画作问答系统中,所述回答数据包括画作数据或者用于提取所述画作数据的提取信息。For example, in the painting question answering system provided by at least one embodiment of the present disclosure, the answer data includes painting data or extraction information used to extract the painting data.

例如,本公开至少一实施例提供的画作问答系统还包括语音识别服务器。所述语音识别服务器与所述显示终端信号连接,被配置为识别来自所述显示终端的语音信息以获得所述文本信息。For example, the painting question answering system provided by at least one embodiment of the present disclosure further includes a voice recognition server. The voice recognition server is in signal connection with the display terminal, and is configured to recognize voice information from the display terminal to obtain the text information.

例如,在本公开至少一实施例提供的画作问答系统中,所述问答服务器包括WEB服务器和语义服务器;所述问答服务器包括WEB服务器和语义服务器;所述WEB服务器分别与所述显示终端和所述语义服务器信号连接;所述WEB服务器被配置为接收来自所述显示终端的请求数据,解析所述请求数据以获取所述文本信息,并将所述文本信息发送给所述语义服务器,以及将所述语义服务器根据所述文本信息获取的所述回答数据经由所述WEB服务器返回给所述显示终端;以及所述语义服务器被配置为接收来自所述WEB服务器的文本信息,获取所述显示终端的当前对话状态,并对所述文本信息进行语义理解以获取用户的当前意图;根据所述当前对话状态和所述当前意图确定目标对话状态;根据所述目标对话状态获取所述文本信息对应的回答数据;和将所述回答数据发送至所述WEB服务器。For example, in the painting question and answer system provided by at least one embodiment of the present disclosure, the question and answer server includes a WEB server and a semantic server; the question and answer server includes a WEB server and a semantic server; the WEB server is connected to the display terminal and the The semantic server signal connection; the WEB server is configured to receive request data from the display terminal, parse the request data to obtain the text information, and send the text information to the semantic server, and The answer data obtained by the semantic server according to the text information is returned to the display terminal via the WEB server; and the semantic server is configured to receive text information from the WEB server, and obtain the display terminal The current dialogue state of the text information is understood to obtain the user’s current intention; the target dialogue state is determined according to the current dialogue state and the current intention; the text information corresponding to the text information is obtained according to the target dialogue state Answer data; and sending the answer data to the WEB server.

例如,本公开至少一实施例提供的画作问答系统还包括存储回答数据的数据库服务器。所述数据库服务器配置为存储所述画作数据。For example, the painting question answering system provided by at least one embodiment of the present disclosure further includes a database server storing answer data. The database server is configured to store the painting data.

例如,在本公开至少一实施例提供的画作问答系统中,所述数据库服务器与所述问答服务器信号连接,被配置为响应于所述问答服务器的请求信息,将所述请求信息对应的画作数据返回给所述问答服务器,所述问答服务器将所述画作数据作为所述回答数据发送给所述显示终端。For example, in the painting question-and-answer system provided by at least one embodiment of the present disclosure, the database server is in signal connection with the question-and-answer server, and is configured to respond to request information from the question-and-answer server to transfer painting data corresponding to the request information Return to the question and answer server, and the question and answer server sends the painting data as the answer data to the display terminal.

例如,在本公开至少一实施例提供的画作问答系统中,所述数据库服务器与所述显示终端信号连接,所述显示终端配置为使用所述提取信息从所述 数据库服务器中提取所述画作数据。所述数据库服务器配置为响应于所述显示终端发送的所述提取信息,并将所述提取信息对应的画作数据发送给所述显示终端。For example, in the painting question and answer system provided by at least one embodiment of the present disclosure, the database server is signally connected to the display terminal, and the display terminal is configured to use the extraction information to extract the painting data from the database server . The database server is configured to respond to the extraction information sent by the display terminal, and send painting data corresponding to the extraction information to the display terminal.

本公开至少一实施例还提供一种画作问答装置,包括:处理器;存储器,包括一个或多个计算机程序模块;其中,所述一个或多个计算机程序模块被存储在所述存储器中并被配置为由所述处理器执行,所述一个或多个计算机程序模块包括用于实现上述实施例提供的画作问答方法的指令。At least one embodiment of the present disclosure further provides a painting question and answer device, including: a processor; a memory, including one or more computer program modules; wherein, the one or more computer program modules are stored in the memory and are It is configured to be executed by the processor, and the one or more computer program modules include instructions for implementing the painting question and answer method provided in the foregoing embodiment.

本公开至少一实施例还提供一种可读存储介质,其上存储有计算机指令。所述计算机指令被处理器执行时实现上述实施例提供的的画作问答方法。At least one embodiment of the present disclosure also provides a readable storage medium on which computer instructions are stored. When the computer instructions are executed by the processor, the painting question-and-answer method provided in the foregoing embodiment is implemented.

附图说明Description of the drawings

此处的附图被并入说明书中并构成本说明书的一部分,示出了符合本公开的实施例,并与说明书一起用于解释本公开的原理。为了更清楚地说明本公开实施例的技术方案,下面将对实施例的附图作简单地介绍,显而易见地,下面描述中的附图仅仅涉及本公开的一些实施例,而非对本公开的限制。The drawings herein are incorporated into the specification and constitute a part of the specification, show embodiments in accordance with the disclosure, and together with the specification are used to explain the principle of the disclosure. In order to explain the technical solutions of the embodiments of the present disclosure more clearly, the following will briefly introduce the drawings of the embodiments. Obviously, the drawings in the following description only relate to some embodiments of the present disclosure, rather than limit the present disclosure. .

图1是根据本公开实施例示出的一种画作问答系统的框图;Fig. 1 is a block diagram of a painting question answering system according to an embodiment of the present disclosure;

图2是根据本公开实施例示出的一种状态转换表的示意图;Fig. 2 is a schematic diagram showing a state transition table according to an embodiment of the present disclosure;

图3是根据本公开实施例示出的获取回答数据的流程图;FIG. 3 is a flowchart of obtaining answer data according to an embodiment of the present disclosure;

图4是根据本公开一实施例示出的获取当前意图的流程图;Fig. 4 is a flowchart of obtaining current intentions according to an embodiment of the present disclosure;

图5是根据本公开另一实施例示出的获取当前意图的流程图;Fig. 5 is a flow chart showing obtaining current intention according to another embodiment of the present disclosure;

图6是根据本公开实施例示出的另一种画作问答系统的框图;Fig. 6 is a block diagram of another painting question answering system according to an embodiment of the present disclosure;

图7是根据本公开实施例示出的又一种画作问答系统的框图;FIG. 7 is a block diagram of another painting question and answer system according to an embodiment of the present disclosure;

图8是根据本公开实施例示出的又一种画作问答系统的框图;Fig. 8 is a block diagram of another painting question answering system according to an embodiment of the present disclosure;

图9是根据本公开实施例示出的又一种画作问答系统的框图;FIG. 9 is a block diagram of another painting question answering system according to an embodiment of the present disclosure;

图10是根据本公开实施例示出的一种画作问答装置的框图;Fig. 10 is a block diagram of a painting question answering device according to an embodiment of the present disclosure;

图11是根据本公开实施例示出的另一种画作问答装置的示意图;FIG. 11 is a schematic diagram of another painting question and answer device according to an embodiment of the present disclosure;

图12是根据本公开实施例示出的一种显示终端的示意图;和Fig. 12 is a schematic diagram showing a display terminal according to an embodiment of the present disclosure; and

图13是根据本公开实施例示出的一种可读存储介质的示意图。Fig. 13 is a schematic diagram showing a readable storage medium according to an embodiment of the present disclosure.

具体实施方式detailed description

这里结合附图,将详细地对示例性实施例进行说明。下面的描述涉及附图时,除非另有表示,不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本公开相一致的所有实施方式。相反,它们仅是与如所附权利要求书中所详述的、本公开的一些方面相一致的装置和方法的例子。Herein, the exemplary embodiments will be described in detail in conjunction with the drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings indicate the same or similar elements. The implementation manners described in the following exemplary embodiments do not represent all implementation manners consistent with the present disclosure. Rather, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

除非另外定义,本公开使用的技术术语或者科学术语应当为本公开所属领域内具有一般技能的人士所理解的通常意义。本公开中使用的“第一”、“第二”以及类似的词语并不表示任何顺序、数量或者重要性,而只是用来区分不同的组成部分。同样,“一个”、“一”或者“该”等类似词语也不表示数量限制,而是表示存在至少一个。“包括”或者“包含”等类似的词语意指出现该词前面的元件或者物件涵盖出现在该词后面列举的元件或者物件及其等同,而不排除其他元件或者物件。“连接”或者“相连”等类似的词语并非限定于物理的或者机械的连接,而是可以包括电性的连接,不管是直接的还是间接的。“上”、“下”、“左”、“右”等仅用于表示相对位置关系,当被描述对象的绝对位置改变后,则该相对位置关系也可能相应地改变。Unless otherwise defined, the technical terms or scientific terms used in the present disclosure shall have the usual meanings understood by those with ordinary skills in the field to which this disclosure belongs. The "first", "second" and similar words used in the present disclosure do not indicate any order, quantity, or importance, but are only used to distinguish different components. Similarly, similar words such as "a", "one" or "the" do not mean quantity limitation, but mean that there is at least one. "Include" or "include" and other similar words mean that the element or item appearing before the word encompasses the element or item listed after the word and its equivalents, but does not exclude other elements or items. Similar words such as "connected" or "connected" are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "Up", "Down", "Left", "Right", etc. are only used to indicate the relative position relationship. When the absolute position of the described object changes, the relative position relationship may also change accordingly.

目前,在线平台,如在线艺术画廊,作为观赏艺术画作以及分享艺术创作的平台受到大众的广泛关注。用户可以通过在线平台查询、欣赏、交易各艺术画作。Currently, online platforms, such as online art galleries, have received widespread public attention as platforms for viewing art paintings and sharing artistic creations. Users can inquire, appreciate and trade various art paintings through the online platform.

在一些情形下,在线平台可以根据用户的每次操作,获取用户的意图,然后显示相应的画作。上述方案可以应用于各次操作没有关联的场景,若用户相邻的几次操作具有关联,则无法正确获取用户意图,导致在线平台无法展现出用户期望的画作,降低用户使用体验。In some cases, the online platform can obtain the user's intention according to each operation of the user, and then display the corresponding painting. The above solution can be applied to scenarios where each operation is not related. If several adjacent operations of the user are related, the user's intention cannot be correctly obtained, which causes the online platform to fail to display the paintings desired by the user and reduces the user experience.

为此,本公开实施例提供了一种画作问答方法、画作问答装置以及画作问答系统,在理解用户的当前意图后,再结合当前对话状态确定目标对话状态,从而可以得到用户期望的画作。To this end, embodiments of the present disclosure provide a painting question-and-answer method, painting question-and-answer device, and painting question-and-answer system. After understanding the user's current intention, the target dialogue state is determined in combination with the current dialogue state, so that the painting desired by the user can be obtained.

本公开至少一实施例所提供的技术方案还可以通过记录用户的对话状态,在上一次操作的基础上获取用户当前操作的当前意图,结合当前意图从当前对话状态切换到下一个目标对话状态,即本公开实施例提供的技术方案可以准确获取相邻操作的意图,确定出用户期望的画作,从而提升用户使用 显示终端的体验。The technical solution provided by at least one embodiment of the present disclosure can also obtain the current intention of the user’s current operation based on the previous operation by recording the user’s conversation state, and switch from the current conversation state to the next target conversation state in combination with the current intention. That is, the technical solutions provided by the embodiments of the present disclosure can accurately obtain the intention of adjacent operations, and determine the painting desired by the user, thereby improving the user's experience of using the display terminal.

后续将以一种画作问答系统为示例描述本申请提供的方案,图1是根据本公开实施例示出的一种画作问答系统的框图。In the following, a painting question and answer system will be used as an example to describe the solution provided by this application. FIG. 1 is a block diagram of a painting question and answer system according to an embodiment of the present disclosure.

参见图1,在一实施例中,一种画作问答系统10包括显示终端100和问答服务器200。例如,显示终端100可以是画屏终端,也可以是数码相框、手机、平板电脑等任意适用的电子设备,或者是特定的软件应用程序等(该软件应用程序例如安装在任意的电子设备中且可由该电子设备运行),它们可以通过无线或有线方式与互联网连接,使用户能够查询、欣赏和交易数字作品(例如数字画作),该数字画作可以通过电子设备中的显示装置显示。例如,显示终端100和问答服务器200可以通过通信网络(例如有线局域网、无线局域网、3G/4G/5G通信网络等任意适用的网络)并基于相应的通信协议进行通信,以传输数据。例如,显示终端100被配置为将请求数据发送给问答服务器200。例如,该请求数据包括文本信息,该文本信息例如是非结构化的,例如,文本信息可以为用户直接输入的文本内容,或者为识别用户输入的语音信息以后得到的文本内容。Referring to FIG. 1, in an embodiment, a paintingquestion answering system 10 includes adisplay terminal 100 and aquestion answering server 200. For example, thedisplay terminal 100 may be a screen-painting terminal, any applicable electronic device such as a digital photo frame, a mobile phone, a tablet computer, etc., or a specific software application program, etc. (The software application program is for example installed in any electronic device and can be The electronic equipment runs), they can be connected to the Internet in a wireless or wired manner, enabling users to inquire, appreciate and trade digital works (such as digital paintings), which can be displayed on the display device in the electronic equipment. For example, thedisplay terminal 100 and the question and answerserver 200 may communicate through a communication network (for example, any applicable network such as a wired local area network, a wireless local area network, a 3G/4G/5G communication network, etc.) and based on a corresponding communication protocol to transmit data. For example, thedisplay terminal 100 is configured to send request data to the question and answerserver 200. For example, the request data includes text information. The text information is, for example, unstructured. For example, the text information may be text content directly input by the user, or text content obtained after recognizing the voice information input by the user.

问答服务器200被配置为获取来自显示终端100的文本信息以及显示终端100的当前对话状态,并对文本信息进行语义理解以获取用户的当前意图,然后根据当前对话状态和当前意图确定目标对话状态,根据目标对话状态获取文本信息对应的回答数据。例如,回答数据包括画作数据,还可以包括用于提取画作数据的提取信息,例如,该提取信息可以是响应信息(包括例如,针对用户提问的问答结果等)、用于通信的协议信息、加密信息以及与画作数据对应的索引信息等。该画作数据例如可以为画作的图像文件。例如,显示终端100还被配置为显示问答服务器200返回的回答数据中包括的画作数据。The question and answerserver 200 is configured to obtain text information from thedisplay terminal 100 and the current dialogue state of thedisplay terminal 100, and perform semantic understanding of the text information to obtain the current intention of the user, and then determine the target dialogue state according to the current dialogue state and the current intention, Obtain the answer data corresponding to the text information according to the target dialogue state. For example, the answer data includes painting data, and may also include extraction information used to extract the painting data. For example, the extraction information may be response information (including, for example, question and answer results for user questions, etc.), protocol information for communication, and encryption Information and index information corresponding to the painting data. The painting data may be, for example, an image file of the painting. For example, thedisplay terminal 100 is also configured to display painting data included in the answer data returned by the question and answerserver 200.

需要说明的是,问答服务器200每接收来自显示终端100的一次文本信息,就会根据状态转换表确定一次对话状态,并将该对话状态作为目标对话状态;进而,在接收到下一次文本信息后,该目标对话状态可以作为确定下一次文本信息的对话状态的当前对话状态。这样,用户输入的相邻两次文本信息的意图可以形成关联,从而可以正确理解用户的当前意图。It should be noted that each time the question and answerserver 200 receives a text message from thedisplay terminal 100, it will determine a dialogue state according to the state conversion table and use the dialogue state as the target dialogue state; furthermore, after receiving the next text message , The target dialogue state can be used as the current dialogue state to determine the dialogue state of the next text message. In this way, the intentions of two adjacent text information input by the user can be associated, so that the current intention of the user can be correctly understood.

在本公开的一些实施例中,状态转换表中可以包括多个对话状态以及多 个意图,不同对话状态根据相应的意图可以切换到下一个对话状态。参见图2,在一实施例中,以4个对话状态和6个意图为例,对话状态1在当前意图为意图1时可以切换到对话状态4,对话状态1在当前意图为意图2时可以切换到对话状态2,对话状态1在当前意图为意图5时可以切换到对话状态3。类似地,对话状态2在当前意图为意图3时可以切换到对话状态4,对话状态3在当前意图为意图6时可以切换到对话状态2,对话状态3在当前意图为意图4时可以切换到对话状态4。In some embodiments of the present disclosure, the state transition table may include multiple dialogue states and multiple intents, and different dialogue states can be switched to the next dialogue state according to the corresponding intent. Referring to Figure 2, in an embodiment, taking 4 dialogue states and 6 intentions as an example, dialogue state 1 can be switched to dialogue state 4 when the current intent is intent 1, and dialogue state 1 can be switched to when the current intent is intent 2. Switch to dialogue state 2, dialogue state 1 can be switched to dialogue state 3 when the current intention is intention 5. Similarly, dialogue state 2 can be switched to dialogue state 4 when the current intention is intent 3, dialogue state 3 can be switched to dialogue state 2 when the current intention is intent 6, and dialogue state 3 can be switched to dialogue state when the current intention is intent 4. Dialogue state 4.

例如,当前的对话状态是“今天的天气怎么样?”,用户输入的内容(即,意图)是“明天呢?”,则可以根据当前对话状态和当前意图,切换到目标对话状态“明天的天气怎么样?”。可见,单从用户的一次输入文本信息(即,“明天呢”),无法确定用户的具体含义,而将用户输入的相邻两次文本信息(即,“今天的天气怎么样?”和“明天呢?”)形成关联,可以正确理解用户的当前意图。For example, if the current dialogue state is "What’s the weather like today?" and the user’s input (i.e., intention) is "tomorrow?", the target dialogue state can be switched to the target dialogue state "tomorrow's how is the weather?". It can be seen that only one input of text information by the user (ie, "tomorrow") cannot determine the specific meaning of the user, and the text information input by the user twice (ie, "how is the weather today?" and " What about tomorrow?”) Form associations and understand the user’s current intentions correctly.

需要说明的是,图2中示出的状态转换表仅仅是示例性的,本公开的实施例对状态转换表中的对话状态和意图的个数和内容不作限制,它们之间的具体切换方式也不作限制,可以根据实际需求进行调整。可理解的是,状态转换表可以预先存储在问答服务器200之内。例如,该状态转换表可以由技术人员根据实际经验进行设置,也可以根据大数据方式统计或者学习得到,本公开的实施例不作限定。It should be noted that the state transition table shown in FIG. 2 is only exemplary, and the embodiment of the present disclosure does not limit the number and content of the dialog states and intentions in the state transition table, and the specific switching manner between them There are no restrictions, and adjustments can be made according to actual needs. It is understandable that the state transition table can be stored in the question and answerserver 200 in advance. For example, the state conversion table may be set by a technician based on actual experience, or it may be obtained by statistics or learning based on big data, which is not limited in the embodiment of the present disclosure.

参见图3,在一实施例中,问答服务器200基于状态转换表(例如,图2中所示的状态转换表)获取回答数据,可以包括如下操作:问答服务器200获取来自显示终端100的文本信息(对应步骤301),问答服务器200对文本信息进行语义理解,从而获取用户的当前意图(对应步骤302)。Referring to FIG. 3, in an embodiment, the question and answerserver 200 obtains answer data based on a state transition table (for example, the state transition table shown in FIG. 2), which may include the following operations: the question and answerserver 200 obtains text information from the display terminal 100 (Corresponding to step 301), the question and answerserver 200 performs semantic understanding of the text information, thereby obtaining the current intention of the user (corresponding to step 302).

例如,在一实施例中,问答服务器200中可以预先存储命名实体识别模型和深度学习模型。For example, in an embodiment, the question and answerserver 200 may pre-store the named entity recognition model and the deep learning model.

参见图4,问答服务器200可以识别文本信息的命名实体(对应步骤401)。问答服务器200可以根据命名实体确定命名实体对应的待识别向量(对应步骤402)。问答服务器200可以基于待识别向量,将满足要求的标准特征向量的意图确定为文本信息的当前意图(对应步骤403)。Referring to FIG. 4, the question and answerserver 200 can identify the named entity of the text information (corresponding to step 401). The question and answerserver 200 may determine the vector to be recognized corresponding to the named entity according to the named entity (corresponding to step 402). The question and answerserver 200 may determine the intention of the standard feature vector that meets the requirements as the current intention of the text information based on the vector to be recognized (corresponding to step 403).

例如,在一实施例中,问答服务器200可以通过命名实体识别模型来识 别文本信息的命名实体。命名实体识别可以是指识别文本中具有特定意义的实体,如人名、机构名、地名等专有名词和有意义的时间等,是信息检索、问答系统等技术的基础任务。如在“小明在夏威夷度假。”中,命名实体有:“小明——人名”、“夏威夷——地名”。可以使用基于语言语法的技术以及统计模型(如机器学习)等,来建立命名实体识别系统。使用实体检测与识别的途径包括:(1)先进行实体检测,再去对已经检测的实体进行识别,(2)将实体与识别的对象结合到一个模型里,同时得到字符的位置进行标记和类别标记。For example, in an embodiment, the question and answerserver 200 may recognize the named entity of the text information through a named entity recognition model. Named entity recognition can refer to the recognition of entities with specific meanings in the text, such as proper nouns such as person names, organization names, and place names, and meaningful time. It is the basic task of information retrieval, question and answer systems and other technologies. For example, in "Xiao Ming is on vacation in Hawaii.", the named entities are: "Xiao Ming-name of person", "Hawaii-name of place". You can use language grammar-based techniques and statistical models (such as machine learning) to establish a named entity recognition system. The ways to use entity detection and recognition include: (1) first perform entity detection, and then identify the detected entity, (2) combine the entity and the recognized object into a model, and obtain the position of the character for marking and Category tag.

需要说明的是,问答服务器200也可以通过其他模型或者其他方法来识别文本信息的命名实体,本公开的实施例对此不作限制。It should be noted that the question and answerserver 200 may also use other models or other methods to identify the named entity of the text information, which is not limited in the embodiment of the present disclosure.

例如,在一实施例中,问答服务器200可以通过深度学习模型来根据命名实体确定命名实体对应的待识别向量。需要说明的是,问答服务器200也可以通过其他模型或者其他方法来根据命名实体确定命名实体对应的待识别向量,本公开的实施例对此不作限制。For example, in an embodiment, thequestion answering server 200 may determine the vector to be recognized corresponding to the named entity according to the named entity through a deep learning model. It should be noted that the question and answerserver 200 may also determine the vector to be recognized corresponding to the named entity according to the named entity through other models or other methods, which is not limited in the embodiment of the present disclosure.

例如,在一实施例中,问答服务器200可以基于待识别向量,将与待识别向量的相似度最大的标准特征向量的意图确定为文本信息的当前意图。需要说明的是,上述满足要求的标准特征向量除了是与待识别向量的相似度最大的标准特征向量,也可以是其他标准特征向量,这取决于实际情况,因此,本公开的实施例对此不作具体限制。For example, in an embodiment, the question and answerserver 200 may determine the intent of the standard feature vector with the greatest similarity to the vector to be recognized as the current intent of the text information based on the vector to be recognized. It should be noted that, in addition to the standard feature vector that has the greatest similarity to the vector to be recognized, the standard feature vector that meets the requirements can also be other standard feature vectors, depending on the actual situation. Therefore, the embodiment of the present disclosure is No specific restrictions.

例如,在一实施例中,参见图5,问答服务器200接收到文本信息“我想看蒙娜丽莎”后,将其输入到命名实体识别模型,通过命名实体识别模型识别出命名实体“我想看PICTURE(画作)”。命名实体识别模型对所接收到的文本信息执行以下操作:命名实体识别模型将一串字符(例如,对应于文本信息中的句子或段落)作为输入,并识别该字符串中提到的相关名词(人物、地点和组织)。For example, in one embodiment, referring to FIG. 5, after the question and answerserver 200 receives the text message "I want to see Mona Lisa", it inputs it into the named entity recognition model, and recognizes the named entity "I I want to see PICTURE". The named entity recognition model performs the following operations on the received text information: The named entity recognition model takes a string of characters (for example, corresponding to a sentence or paragraph in the text information) as input, and recognizes related nouns mentioned in the string (People, places and organizations).

例如,在一个实施例中,输入到命名实体识别模型中的文本信息为:[我,想,看,莫,奈,的,撑,阳,伞,的,女,人,O,…,O];则通过命名实体识别模型识别出的命名实体为:[O,O,O,B-PER,I-PER,O,B-PIC,I-PIC,I-PIC,I-PIC,I-PIC,I-PIC,O,…,O],即命名实体为:人物-莫奈,画作-撑阳伞的女人。For example, in one embodiment, the text information input into the named entity recognition model is: [I, think, look, Mo, Nai,, zhang, sun, umbrella,, female, person, O,..., O ]; The named entity identified by the named entity recognition model is: [O, O, O, B-PER, I-PER, O, B-PIC, I-PIC, I-PIC, I-PIC, I- PIC, I-PIC, O,..., O], the named entities are: character-Monet, painting-woman with parasol.

例如,在一个实施例中,通过命名实体识别模型识别出的命名实体经过深度学习模型后可以确定出其对应的待识别向量。例如,待识别向量可以是一种特征向量,其包括通过深度学习模型从命名实体中分类并提取出的文本特征。For example, in one embodiment, the named entity recognized by the named entity recognition model can determine its corresponding to-be-recognized vector after passing through the deep learning model. For example, the vector to be recognized may be a feature vector, which includes text features that are classified and extracted from named entities by a deep learning model.

例如,在一实施例中,问答服务器200中还包括语料库,该语料库中包括大量的语料,例如“换PIC(画作)看”、“作者的国籍”、“PERSON的画”等等,问答服务器200将语料输入到深度学习模型可以得到多个标准特征向量。例如,标准特征向量可以是一种包括通过深度学习模型从语料中分类并提取出的文本特征的特征向量。For example, in one embodiment, the question and answerserver 200 also includes a corpus, which includes a large number of corpora, such as "change PIC (painting)", "author's nationality", "PERSON's painting", etc., the question and answerserver 200 Input the corpus into the deep learning model to obtain multiple standard feature vectors. For example, the standard feature vector may be a feature vector that includes text features classified and extracted from the corpus through a deep learning model.

需要说明的是,获取标准特征向量的动作可以预先完成,也可以实时完成,可根据具体场景进行设置,本公开的实施例对此不作限定。It should be noted that the action of obtaining the standard feature vector can be completed in advance, or can be completed in real time, and can be set according to a specific scenario, which is not limited in the embodiment of the present disclosure.

需要说明的是,在本公开的实施例中,通过深度学习模型可以将不同表示方式但具有同一目的的句子归为同一个意图。例如:“我想看蒙娜丽莎”、“帮我换蒙娜丽莎吧”、“给我切换到蒙娜丽莎看看”等,可以归为同一意图“用户想换PIC(蒙娜丽莎)看看”。It should be noted that, in the embodiments of the present disclosure, sentences with different representations but with the same purpose can be classified into the same intent through the deep learning model. For example: "I want to see the Mona Lisa", "Help me change the Mona Lisa", "Show me to switch to the Mona Lisa", etc., can be classified as the same intention "The user wants to change the PIC (Mona Lisa) Take a look".

这样,本实施例中通过将不同表示方式但具有同一目的的句子归为同一意图,有利于提高确定意图的准确性。In this way, in this embodiment, by classifying sentences with different expressions but with the same purpose as the same intention, it is beneficial to improve the accuracy of determining the intention.

例如,在一实施例中,问答服务器200可以获取待识别向量和多个标准特征向量的余弦相似度,将相似度最大的标准特征向量的意图作为待识别向量的当前意图,即文本信息“我想看蒙娜丽莎”的当前意图“换幅PIC看看”。For example, in one embodiment, the question and answerserver 200 may obtain the cosine similarity between the vector to be recognized and multiple standard feature vectors, and use the intent of the standard feature vector with the greatest similarity as the current intent of the vector to be recognized, that is, the text message "I "I want to see the Mona Lisa"'s current intention "to change the PIC".

返回图3,问答服务器200在获取到文本信息后,还可以获取显示终端的100当前对话状态(对应步骤301),这样问答服务器200可以根据当前对话状态和当前意图确定出目标对话状态(对应步骤303),问答服务器200可以根据目标对话状态获取文本信息对应的回答数据(对应步骤304)。Returning to FIG. 3, after obtaining the text information, the question and answerserver 200 can also obtain the current dialogue state of the display terminal 100 (corresponding to step 301), so that the question and answerserver 200 can determine the target dialogue state according to the current dialogue state and current intention (corresponding step 303) The question and answerserver 200 can obtain the answer data corresponding to the text information according to the target dialogue state (corresponding to step 304).

需要说明的是,问答服务器200可以根据目标对话状态,结合当前意图以及文本信息,来确定出回答数据。例如,当前意图为“换幅PIC看看”,文本信息中已经确定PIC对应的槽位信息为“蒙娜丽莎”,从而可以确定出回答数据为画作数据“蒙娜丽莎”以及文字模板“已为您推荐达芬奇的蒙娜丽莎”。It should be noted that the question and answerserver 200 can determine the answer data according to the target dialogue state, combined with the current intention and text information. For example, the current intention is "Look at the PIC", and the slot information corresponding to the PIC has been determined to be "Mona Lisa" in the text information, so it can be determined that the answer data is the painting data "Mona Lisa" and the text template "I have recommended Leonardo's Mona Lisa for you."

最后,问答服务器200将确定了的回答数据发送至显示终端100,显示 终端100可以接收并显示基于回答数据的画作数据,并且根据需要还可以显示对应的文字模板以提示用户。Finally, the question and answerserver 200 sends the determined answer data to thedisplay terminal 100, and thedisplay terminal 100 can receive and display the painting data based on the answer data, and can also display corresponding text templates to prompt the user as needed.

在一些实施例中,来自显示终端100的文本信息,可以为用户直接输入的文本内容,也可以为识别用户输入的语音信息以后得到的文本内容。In some embodiments, the text information from thedisplay terminal 100 may be text content directly input by the user, or text content obtained after recognizing the voice information input by the user.

例如,在一实施例中,以用户向显示终端100输入语音信息为例,该语音信息可以由显示终端100直接识别,也可以由语音识别服务器识别。参见图6,一种画作问答系统10除了包括显示终端100和问答服务器200,还可以包括语音识别服务器300。该语音识别服务器300与显示终端100信号连接,被配置为识别来自显示终端100的语音信息,并将识别出的语音结果(文本信息)返回显示终端100。For example, in an embodiment, taking the user inputting voice information to thedisplay terminal 100 as an example, the voice information may be directly recognized by thedisplay terminal 100 or may be recognized by a voice recognition server. Referring to FIG. 6, a painting question andanswer system 10 may include avoice recognition server 300 in addition to adisplay terminal 100 and a question and answerserver 200. Thevoice recognition server 300 is signally connected to thedisplay terminal 100 and is configured to recognize voice information from thedisplay terminal 100 and return the recognized voice result (text information) to thedisplay terminal 100.

例如,问答服务器200和语音识别服务器300可以为服务器集群中的各个独立的服务器,也可以分别为某一服务器中运行的各个独立的服务进程,也即是,问答服务器200可以指服务器,也可以指服务进程,语音识别服务器300与此类似,本公开的实施例对此不作限制。例如,问答服务器200和语音识别服务器300还可以为虚拟服务器,并运行在任意的物理设备、私有云或公有云中。对于问答服务器200和语音识别服务器300的具体实现方式,本公开的实施例不作限制。例如,显示终端100、问答服务器200和语音识别服务器300都可以部署在同一局域网或广域网中。For example, the question and answerserver 200 and thespeech recognition server 300 may be independent servers in a server cluster, or may be independent service processes running in a server, that is, the question and answerserver 200 may refer to a server or Refers to the service process, thevoice recognition server 300 is similar to this, and the embodiment of the present disclosure does not limit this. For example, the question and answerserver 200 and thespeech recognition server 300 may also be virtual servers and run in any physical device, private cloud or public cloud. The specific implementation of the question and answerserver 200 and thevoice recognition server 300 is not limited in the embodiment of the present disclosure. For example, thedisplay terminal 100, the question and answerserver 200, and thevoice recognition server 300 may all be deployed in the same local area network or wide area network.

需要说明的是,本公开的实施例对语音识别的具体过程、方法不作具体限制。It should be noted that the embodiments of the present disclosure do not specifically limit the specific process and method of speech recognition.

在该实施例中,通过增加语音识别服务器300,语音识别过程无需显示终端100完成,可以降低显示终端100的数据处理量和数据存储量,有利于提升数据处理效率。In this embodiment, by adding thevoice recognition server 300, the voice recognition process does not need to be completed by thedisplay terminal 100, which can reduce the data processing volume and data storage volume of thedisplay terminal 100, which is beneficial to improve the data processing efficiency.

在一些实施例中,参见图7,问答服务器200还可以包括WEB服务器201和语义服务器202。例如,该WEB服务器201可以是一种转换服务器,分别与显示终端100和语义服务器202信号连接。WEB服务器201被配置为接收来自显示终端100的请求数据,解析该请求数据以获取文本信息,并将文本信息发送给语义服务器202,以及将语义服务器202根据文本信息确定出的回答数据经由WEB服务器201返回给显示终端100。例如,来自显示终端100的请求数据可以包括显示终端100的设备ID、语音识别服务器300识 别出的文本信息或者用户输入的文本信息、当前显示的画作数据等,因此,需要WEB服务器201对请求数据进行解析以获取请求数据中所包含的文本信息。In some embodiments, referring to FIG. 7, the question and answerserver 200 may further include aWEB server 201 and asemantic server 202. For example, theWEB server 201 may be a conversion server, which is signally connected to thedisplay terminal 100 and thesemantic server 202 respectively. TheWEB server 201 is configured to receive request data from thedisplay terminal 100, parse the request data to obtain text information, send the text information to thesemantic server 202, and send the answer data determined by thesemantic server 202 according to the text information via theWEB server 201 returns to thedisplay terminal 100. For example, the request data from thedisplay terminal 100 may include the device ID of thedisplay terminal 100, text information recognized by thevoice recognition server 300 or text information input by the user, currently displayed painting data, etc. Therefore, theWEB server 201 is required to request data Parse to obtain the text information contained in the request data.

语义服务器202根据文本信息确定出回答数据的具体过程,可以参见图4和图5所示实施例的内容,在此不再赘述。在确定了回答数据之后,语义服务器202可以将回答数据发送至WEB服务器,由WEB服务器201返回给显示终端100。The specific process for thesemantic server 202 to determine the answer data according to the text information may refer to the content of the embodiments shown in FIG. 4 and FIG. 5, which will not be repeated here. After the answer data is determined, thesemantic server 202 can send the answer data to the WEB server, and theWEB server 201 returns to thedisplay terminal 100.

本实施例中,WEB服务器201可以转换显示终端100和语义服务器202之间的数据形式,从而保证数据传输效率。并且,语义服务器202可以准确识别出文本信息的当前意图,然后结合当前意图和当前对应状态确定出的回答数据,将回答数据经由WEB服务器201返回给显示终端100,提升回答数据处理效率及识别效率。In this embodiment, theWEB server 201 can convert the data format between thedisplay terminal 100 and thesemantic server 202, thereby ensuring data transmission efficiency. In addition, thesemantic server 202 can accurately identify the current intention of the text information, and then combine the current intention and the answer data determined by the current corresponding state, and return the answer data to thedisplay terminal 100 via theWEB server 201, thereby improving the processing efficiency and recognition efficiency of answer data .

在一些实施例中,参见图8,一种画作问答系统10,除包括显示终端100和问答服务器200,还可以包括存储画作数据的数据库服务器400。数据库服务器400与问答服务器200信号连接,被配置为响应于问答服务器200的请求信息,将请求信息对应的画作数据返回给200问答服务器。本实施例中,通过设置数据库服务器可以提高画作数据的查询效率。需要说明的是,在画作问答系统10不包括数据库服务器400时,画作数据可以直接存储在问答服务器200上或存储在另行提供的其他存储设备中。In some embodiments, referring to FIG. 8, a painting question andanswer system 10 may include adatabase server 400 that stores painting data in addition to adisplay terminal 100 and a question and answerserver 200. Thedatabase server 400 is in signal connection with the question and answerserver 200, and is configured to respond to the request information of the question and answerserver 200 and return painting data corresponding to the request information to the question and answerserver 200. In this embodiment, the query efficiency of painting data can be improved by setting a database server. It should be noted that when the painting question andanswer system 10 does not include thedatabase server 400, the painting data can be directly stored on the question and answerserver 200 or in other storage devices provided separately.

例如,在另一些实施例中,参见图9,数据库服务器400也可以与所显示终端100信号连接,被配置为响应于显示终端100发送的获取请求,将对应的画作数据发送至显示终端100。此时,问答服务器200发送给显示终端100的回答数据不包括画作数据,该回答数据可以包括提取信息,例如获取许可等。显示终端100配置为使用来自问答服务器200的提取信息从数据库服务器400中提取画作数据。数据库服务器400配置为响应于显示终端100发送的提取信息,并将该提取信息对应的画作数据发送给显示终端100。例如,显示终端100将包含获取许可的获取请求发送至数据库服务器400(也即,将提取信息发送给数据库服务器400),数据库服务器400验证该获取许可后直接将画作数据发送至显示终端100。通过这种方式,可以提高画作数据的获取效率,减轻问答服务器200的负载,使得问答服务器200、数据 库服务器400等多个服务器组成的系统的负载均衡。For example, in other embodiments, referring to FIG. 9, thedatabase server 400 may also be signally connected to the displayedterminal 100 and configured to send corresponding painting data to thedisplay terminal 100 in response to an acquisition request sent by thedisplay terminal 100. At this time, the answer data sent by the question and answerserver 200 to thedisplay terminal 100 does not include painting data, and the answer data may include extraction information, such as obtaining permission. Thedisplay terminal 100 is configured to extract painting data from thedatabase server 400 using extraction information from the question and answerserver 200. Thedatabase server 400 is configured to respond to the extraction information sent by thedisplay terminal 100 and send painting data corresponding to the extraction information to thedisplay terminal 100. For example, thedisplay terminal 100 sends an acquisition request including the acquisition license to the database server 400 (that is, sends the extracted information to the database server 400), and thedatabase server 400 directly sends the painting data to thedisplay terminal 100 after verifying the acquisition license. In this way, the efficiency of obtaining painting data can be improved, the load of the question and answerserver 200 can be reduced, and the load of the system composed of multiple servers such as thequestion answer server 200 and thedatabase server 400 can be balanced.

至此,本实施例中通过记录用户的对话状态,可以在上一次操作的基础上获取当前操作的当前意图,结合当前意图从当前对话状态切换到下一个目标对话状态,即本实施例中可以准确获取相邻操作的意图,确定出用户期望的画作,而无需观看后退回起始状态重新选择画作,从而提升用户使用显示终端的体验。So far, by recording the user’s dialog state in this embodiment, the current intention of the current operation can be obtained on the basis of the previous operation, and combined with the current intention to switch from the current dialog state to the next target dialog state, that is, it can be accurate in this embodiment. The intent of the adjacent operation is obtained, and the painting desired by the user is determined, without having to go back to the initial state after viewing and reselect the painting, thereby improving the user's experience of using the display terminal.

本公开实施例还提供了一种画作问答方法,可以参见图3,包括:The embodiment of the present disclosure also provides a painting question answering method, which can be seen in FIG. 3, including:

步骤301,获取来自显示终端的文本信息,以及获取显示终端的当前对话状态;Step 301, acquiring text information from the display terminal, and acquiring the current dialogue state of the display terminal;

步骤302,对文本信息进行语义理解获取用户的当前意图;Step 302: Perform semantic understanding on the text information to obtain the current intention of the user;

步骤303,根据当前对话状态和当前意图确定目标对话状态;Step 303: Determine the target dialogue state according to the current dialogue state and the current intention;

步骤304,根据目标对话状态获取文本信息对应的回答数据。Step 304: Obtain response data corresponding to the text information according to the target dialogue state.

本实施例中通过记录用户的对话状态,可以在上一次操作的基础上获取当前操作的当前意图,结合当前意图从当前对话状态切换到下一个目标对话状态,即本实施例中可以准确获取相邻操作的意图,确定出用户期望的作品,从而提升用户使用显示终端的体验。In this embodiment, by recording the user’s dialogue state, the current intention of the current operation can be obtained on the basis of the previous operation, and combined with the current intention to switch from the current dialogue state to the next target dialogue state, that is, the relative information can be accurately obtained in this embodiment. The intent of the neighbor operation determines the work desired by the user, thereby enhancing the user’s experience of using the display terminal.

在图3所示的画作问答方法的基础上,继续参见图4,步骤302包括:On the basis of the painting question and answer method shown in FIG. 3, referring to FIG. 4,step 302 includes:

步骤401,识别出文本信息的命名实体;Step 401: Identify the named entity of the text information;

步骤402,根据命名实体确定命名实体对应的待识别向量;Step 402: Determine a vector to be recognized corresponding to the named entity according to the named entity;

步骤403,基于待识别向量,将满足要求的标准特征向量的意图确定为文本信息的当前意图。Step 403: Based on the vector to be recognized, the intent of the standard feature vector that meets the requirements is determined as the current intent of the text information.

例如,本公开的实施例中可以通过命名实体识别模型来识别文本信息的命名实体,可以通过深度学习模型确定出文本信息对应的待识别向量,然后利用待识别向量与标准特征向量的相似度,可以得到文本信息的当前意图,可以提高识别效率。例如,可以将与待识别向量的相似度最大的标准特征向量的意图确定为文本信息的当前意图。For example, in the embodiments of the present disclosure, the named entity of the text information can be recognized by the named entity recognition model, the vector to be recognized corresponding to the text information can be determined by the deep learning model, and then the similarity between the vector to be recognized and the standard feature vector can be used, The current intention of the text information can be obtained, and the recognition efficiency can be improved. For example, the intention of the standard feature vector having the greatest similarity with the vector to be recognized may be determined as the current intention of the text information.

本公开实施例提供的画作问答方法可以应用于问答服务器,由于画作问答系统中已经详细的描述了问答服务器确定回答数据的过程,因此,图3和图4所示画作问答方法的内容可以参见图3和图4所示的内容,在此不再赘述。The painting question answering method provided by the embodiment of the present disclosure can be applied to a question and answer server. Since the painting question answering system has described the process of determining answer data by the question answering server in detail, the content of the painting question answering method shown in FIGS. 3 and 4 can be seen in the figure. The content shown in Figure 3 and Figure 4 will not be repeated here.

本公开的实施例还提供了一种画作问答装置。例如,在一实施例中,如图10所示,画作问答装置90可以包括文本信息获取电路91、当前意图获取电路92、目标状态确定电路93和回答数据获取电路94。例如,文本信息获取电路91可以被配置为获取来自显示终端100的文本信息,以及获取显示终端100的当前对话状态。当前意图获取电路92可以被配置为对文本信息进行语义理解获取用户的当前意图。目标状态确定电路93可以被配置为根据当前对话状态和当前意图确定目标对话状态。回答数据获取电路94可以被配置为根据目标对话状态获取文本信息对应的回答数据。The embodiment of the present disclosure also provides a painting question answering device. For example, in one embodiment, as shown in FIG. 10, the painting question andanswer device 90 may include a textinformation acquisition circuit 91, a currentintention acquisition circuit 92, a targetstate determination circuit 93, and an answerdata acquisition circuit 94. For example, the textinformation obtaining circuit 91 may be configured to obtain text information from thedisplay terminal 100 and obtain the current conversation state of thedisplay terminal 100. The currentintention obtaining circuit 92 may be configured to perform semantic understanding of the text information to obtain the current intention of the user. The targetstate determination circuit 93 may be configured to determine the target dialogue state according to the current dialogue state and the current intention. The answerdata acquisition circuit 94 may be configured to acquire answer data corresponding to the text information according to the target dialogue state.

例如,在一实施例中,当前意图获取电路92可以包括命名实体识别电路921、识别向量确定电路922和当前意图确定电路923。例如,命名实体识别电路921可以被配置为识别出文本信息的命名实体,识别向量确定电路922可以被配置为根据命名实体确定命名实体对应的待识别向量,当前意图确定电路923可以被配置为基于待识别向量,将满足要求的标准特征向量的意图确定为文本信息的当前意图。For example, in an embodiment, the currentintention acquisition circuit 92 may include a namedentity recognition circuit 921, a recognitionvector determination circuit 922, and a currentintention determination circuit 923. For example, the namedentity recognition circuit 921 may be configured to recognize a named entity of text information, the recognitionvector determination circuit 922 may be configured to determine the vector to be recognized corresponding to the named entity according to the named entity, and the currentintention determination circuit 923 may be configured to For the vector to be recognized, the intent of the standard feature vector that meets the requirements is determined as the current intent of the text information.

需要说明的是,本公开实施例中的文本信息获取电路91、当前意图获取电路92、目标状态确定电路93和回答数据获取电路94、命名实体识别电路921、识别向量确定电路922和当前意图确定电路923可以由诸如处理器、控制器等的硬件、能实施相关功能的软件或者两者相结合来实现,本公开的实施例对它们的具体实施方式不作限制。It should be noted that the textinformation acquisition circuit 91, the currentintention acquisition circuit 92, the targetstate determination circuit 93 and the answerdata acquisition circuit 94, the namedentity recognition circuit 921, the recognitionvector determination circuit 922, and the current intention determination in the embodiment of the present disclosure Thecircuit 923 may be implemented by hardware such as a processor, a controller, etc., software capable of implementing related functions, or a combination of the two, and the embodiments of the present disclosure do not limit their specific implementation manners.

需要说明的是,本公开的实施例中,画作问答装置90还可以包括更多的电路,而不限于上述文本信息获取电路91、当前意图获取电路92、目标状态确定电路93和回答数据获取电路94,这可以根据实际需求而定,本公开的实施例对此不作限制。It should be noted that, in the embodiment of the present disclosure, the painting question andanswer device 90 may also include more circuits, and is not limited to the textinformation acquisition circuit 91, the currentintention acquisition circuit 92, the targetstate determination circuit 93, and the answer data acquisition circuit. 94. This may be determined according to actual requirements, and the embodiments of the present disclosure do not limit this.

应当理解的是,本公开实施例提供的画作问答装置90可以实施前述画作问答方法,也可以实现与前述画作问答系统10相似的技术效果,在此不作赘述。It should be understood that the paintingquestion answering device 90 provided by the embodiment of the present disclosure can implement the aforementioned painting question answering method, and can also achieve similar technical effects as the aforementioned paintingquestion answering system 10, which will not be repeated here.

图11为本公开一实施例提供的另一种画作问答装置的示意图。如图11所示,该画作问答装置901包括处理器310和存储器320。存储器320被配置为存储非暂时性计算机可读指令(例如一个或多个计算机程序模块)。处理器310被配置为运行非暂时性计算机可读指令,非暂时性计算机可读指令 被处理器310运行时可以执行上文所述的画作问答方法中的一个或多个步骤。存储器320和处理器310可以通过总线系统和/或其它形式的连接机构(未示出)互连。FIG. 11 is a schematic diagram of another painting question and answer device provided by an embodiment of the disclosure. As shown in FIG. 11, the paintingquestion answering device 901 includes a processor 310 and a memory 320. The memory 320 is configured to store non-transitory computer readable instructions (for example, one or more computer program modules). The processor 310 is configured to execute non-transitory computer-readable instructions, and when the non-transitory computer-readable instructions are executed by the processor 310, one or more steps in the painting question answering method described above can be executed. The memory 320 and the processor 310 may be interconnected by a bus system and/or other forms of connection mechanisms (not shown).

例如,存储器320和处理器310可以设置在服务器端(或云端),例如设置在前述的问答服务器200中,以用于执行图3-图4描述的画作问答方法中的一个或多个步骤。For example, the memory 320 and the processor 310 may be provided on the server side (or the cloud), such as the aforementioned question and answerserver 200, to execute one or more steps in the painting question answering method described in FIGS. 3-4.

例如,处理器310可以是中央处理单元(CPU)、数字信号处理器(DSP)或者具有数据处理能力和/或程序执行能力的其它形式的处理单元,例如现场可编程门阵列(FPGA)等;例如,中央处理单元(CPU)可以为X86或ARM架构等。处理器310可以为通用处理器或专用处理器,可以控制画作问答装置901中的其它组件以执行期望的功能。For example, the processor 310 may be a central processing unit (CPU), a digital signal processor (DSP), or other forms of processing units with data processing capabilities and/or program execution capabilities, such as field programmable gate arrays (FPGA), etc.; For example, the central processing unit (CPU) may be an X86 or ARM architecture. The processor 310 may be a general-purpose processor or a special-purpose processor, and may control other components in the painting question andanswer device 901 to perform desired functions.

例如,存储器320可以包括一个或多个计算机程序产品的任意组合,计算机程序产品可以包括各种形式的计算机可读存储介质,例如易失性存储器和/或非易失性存储器。易失性存储器例如可以包括随机存取存储器(RAM)和/或高速缓冲存储器(cache)等。非易失性存储器例如可以包括只读存储器(ROM)、硬盘、可擦除可编程只读存储器(EPROM)、便携式紧致盘只读存储器(CD-ROM)、USB存储器、闪存等。在计算机可读存储介质上可以存储一个或多个计算机程序模块,处理器310可以运行一个或多个计算机程序模块,以实现画作问答装置901的各种功能。在计算机可读存储介质中还可以存储各种应用程序和各种数据以及应用程序使用和/或产生的各种数据等。画作问答装置901的具体功能和技术效果可以参考上文中关于画作问答方法的描述,此处不再赘述。For example, the memory 320 may include any combination of one or more computer program products, and the computer program product may include various forms of computer-readable storage media, such as volatile memory and/or nonvolatile memory. Volatile memory may include random access memory (RAM) and/or cache memory (cache), for example. The non-volatile memory may include, for example, read only memory (ROM), hard disk, erasable programmable read only memory (EPROM), portable compact disk read only memory (CD-ROM), USB memory, flash memory, etc. One or more computer program modules may be stored on the computer-readable storage medium, and the processor 310 may run one or more computer program modules to implement various functions of the painting question andanswer device 901. The computer-readable storage medium may also store various application programs and various data, various data used and/or generated by the application programs, and the like. For the specific functions and technical effects of the painting question andanswer device 901, reference may be made to the above description of the painting question and answer method, which will not be repeated here.

图12为本公开一实施例提供的一种显示终端100的示意框图。该显示终端100例如可应用于本公开实施例提供的画作问答方法中。需要注意的是,图12示出的显示终端100仅仅是一个示例,其不会对本公开实施例的功能和使用范围带来任何限制。FIG. 12 is a schematic block diagram of adisplay terminal 100 according to an embodiment of the present disclosure. Thedisplay terminal 100 can be applied to, for example, the painting question answering method provided by the embodiment of the present disclosure. It should be noted that thedisplay terminal 100 shown in FIG. 12 is only an example, which does not bring any limitation to the function and scope of use of the embodiments of the present disclosure.

如图12所示,显示终端100可以包括处理装置(例如中央处理器、图形处理器等)610,其可以根据存储在只读存储器(ROM)620中的程序或者从存储装置680加载到随机访问存储器(RAM)630中的程序而执行各种适当的动作和处理。在RAM 630中,还存储有显示终端100操作所需的各种 程序和数据。处理装置610、ROM 620以及RAM 630通过总线640彼此相连。输入/输出(I/O)接口650也连接至总线640。As shown in FIG. 12, thedisplay terminal 100 may include a processing device (such as a central processing unit, a graphics processor, etc.) 610, which may be loaded into a random access device according to a program stored in a read-only memory (ROM) 620 or from astorage device 680. The programs in the memory (RAM) 630 execute various appropriate actions and processes. In theRAM 630, various programs and data required for the operation of thedisplay terminal 100 are also stored. Theprocessing device 610, theROM 620, and theRAM 630 are connected to each other through abus 640. An input/output (I/O)interface 650 is also connected to thebus 640.

通常,以下装置可以连接至I/O接口650:包括例如触摸屏、触摸板、键盘、鼠标、摄像头、麦克风、加速度计、陀螺仪等的输入装置660;包括例如液晶显示器(LCD)、扬声器、振动器等的输出装置670;包括例如磁带、硬盘等的存储装置680;以及通信装置690。通信装置690可以允许显示终端100与其他电子设备进行无线或有线通信以交换数据。虽然图12示出了具有各种装置的显示终端100,但应理解的是,并不要求实施或具备所有示出的装置,显示终端100可以替代地实施或具备更多或更少的装置。Generally, the following devices can be connected to the I/O interface 650: includinginput devices 660 such as touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; including, for example, liquid crystal display (LCD), speakers, vibration Anoutput device 670 such as a device; astorage device 680 such as a magnetic tape, a hard disk, etc.; and acommunication device 690. Thecommunication device 690 may allow thedisplay terminal 100 to perform wireless or wired communication with other electronic devices to exchange data. Although FIG. 12 shows thedisplay terminal 100 having various devices, it should be understood that it is not required to implement or have all the illustrated devices, and thedisplay terminal 100 may alternatively implement or have more or fewer devices.

本公开实施例还提供了一种可读存储介质,其上存储有计算机指令,该指令被处理器执行时实现图3~图4所示实施例的步骤。The embodiment of the present disclosure also provides a readable storage medium on which computer instructions are stored, and when the instructions are executed by a processor, the steps of the embodiments shown in FIGS. 3 to 4 are implemented.

图13为本公开一实施例提供的一种可读存储介质的示意图。如图13所示,存储介质500用于存储非暂时性计算机可读指令510。例如,当非暂时性计算机可读指令510由计算机执行时可以执行根据上文所述的画作问答方法中的一个或多个步骤。FIG. 13 is a schematic diagram of a readable storage medium provided by an embodiment of the present disclosure. As shown in FIG. 13, thestorage medium 500 is used to store non-transitory computer readable instructions 510. For example, when the non-transitory computer-readable instructions 510 are executed by a computer, one or more steps in the painting question answering method described above can be executed.

例如,该存储介质可以是一个或多个计算机可读存储介质的任意组合,例如一个计算机可读存储介质包含用于获取来自显示终端的文本信息以及显示终端的当前对话状态的计算机可读的程序代码,另一个计算机可读存储介质包含对文本信息进行语义理解以获取用户的当前意图的计算机可读的程序代码,又一个计算机可读存储介质包含根据当前对话状态和当前意图确定目标对话状态的计算机可读的程序代码,还有一个计算机可读存储介质包含根据目标对话状态获取文本信息对应的回答数据的计算机可读的程序代码。当然,上述各个程序代码也可以存储在同一个计算机可读介质中,本公开的实施例对此不作限制。例如,当该程序代码由计算机读取时,计算机可以执行该计算机存储介质中存储的程序代码,执行例如本公开任一实施例提供的画作问答方法。For example, the storage medium may be any combination of one or more computer-readable storage media. For example, a computer-readable storage medium contains a computer-readable program for obtaining text information from the display terminal and the current dialog state of the display terminal Code, another computer-readable storage medium contains computer-readable program code that performs semantic understanding of text information to obtain the user’s current intention, and another computer-readable storage medium contains a method for determining the target dialogue state according to the current dialogue state and the current intention Computer-readable program code, and a computer-readable storage medium containing computer-readable program code for obtaining answer data corresponding to the text information according to the target dialogue state. Of course, each of the above-mentioned program codes can also be stored in the same computer-readable medium, which is not limited in the embodiments of the present disclosure. For example, when the program code is read by a computer, the computer can execute the program code stored in the computer storage medium, and execute, for example, the painting question and answer method provided by any embodiment of the present disclosure.

例如,存储介质可以包括智能电话的存储卡、平板电脑的存储部件、个人计算机的硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦除可编程只读存储器(EPROM)、便携式紧致盘只读存储器(CD-ROM)、闪存、或者上述存储介质的任意组合,也可以为其他适用的存储介质。例如,该可读存 储介质也可以为图11中的存储器320,相关描述可以参考前述内容,此处不再赘述。For example, the storage medium may include a memory card of a smart phone, a storage component of a tablet computer, a hard disk of a personal computer, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM), The portable compact disk read-only memory (CD-ROM), flash memory, or any combination of the above storage media can also be other suitable storage media. For example, the readable storage medium may also be the memory 320 in FIG. 11, and the relevant description may refer to the foregoing content, which will not be repeated here.

需要说明的是,可读存储介质可以应用于问答服务器,技术人员可以根据具体场景进行选择,在此不作限定。It should be noted that the readable storage medium can be applied to the question and answer server, and the technician can make a selection according to specific scenarios, which is not limited here.

在本公开中,术语“多个”指两个或两个以上,除非另有明确的限定。In the present disclosure, the term "plurality" refers to two or more, unless specifically defined otherwise.

本领域技术人员在考虑说明书及实践这里公开的公开后,将容易想到本公开的其它实施方案。本公开旨在涵盖本公开的任何变型、用途或者适应性变化,这些变型、用途或者适应性变化遵循本公开的一般性原理并包括本公开未公开的本技术领域中的公知常识或惯用技术手段。说明书和实施例仅被视为示例性的,本公开的真正范围和精神由下面的权利要求指出。After considering the specification and practicing the disclosure disclosed herein, those skilled in the art will easily think of other embodiments of the present disclosure. The present disclosure is intended to cover any variations, uses, or adaptive changes of the present disclosure. These variations, uses, or adaptive changes follow the general principles of the present disclosure and include common knowledge or conventional technical means in the technical field not disclosed in the present disclosure. . The description and the embodiments are to be regarded as exemplary only, and the true scope and spirit of the present disclosure are pointed out by the following claims.

应当理解的是,本公开并不局限于上面已经描述并在附图中示出的精确结构,并且可以在不脱离其范围进行各种修改和改变。本公开的范围仅由所附的权利要求来限制。It should be understood that the present disclosure is not limited to the precise structure that has been described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present disclosure is limited only by the appended claims.

Claims (21)

Translated fromChinese
一种画作问答方法,包括:A question and answer method for paintings, including:获取来自显示终端的文本信息,以及获取所述显示终端的当前对话状态;Acquiring text information from the display terminal, and acquiring the current dialogue state of the display terminal;对所述文本信息进行语义理解以获取用户的当前意图;Semantic understanding of the text information to obtain the current intention of the user;根据所述当前对话状态和所述当前意图确定目标对话状态;Determining the target dialogue state according to the current dialogue state and the current intention;根据所述目标对话状态获取所述文本信息对应的回答数据。Acquire the answer data corresponding to the text information according to the target dialogue state.根据权利要求1所述的画作问答方法,其中,所述回答数据包括画作数据或者用于提取所述画作数据的提取信息。The painting question answering method according to claim 1, wherein the answer data includes painting data or extraction information for extracting the painting data.根据权利要求1或2所述的画作问答方法,其中,对所述文本信息进行语义理解以获取所述用户的当前意图,包括:The painting question answering method according to claim 1 or 2, wherein the semantic understanding of the text information to obtain the current intention of the user comprises:识别所述文本信息的命名实体;Identifying the named entity of the text information;根据所述命名实体确定所述命名实体对应的待识别向量;Determining, according to the named entity, the vector to be recognized corresponding to the named entity;基于所述待识别向量,将满足要求的标准特征向量的意图确定为所述文本信息的当前意图。Based on the to-be-recognized vector, the intent of the standard feature vector that meets the requirements is determined as the current intent of the text information.根据权利要求3所述的画作问答方法,其中,识别所述文本信息的命名实体,包括:The painting question answering method according to claim 3, wherein identifying the named entity of the text information comprises:通过命名实体识别模型识别所述文本信息的命名实体。The named entity of the text information is recognized through the named entity recognition model.根据权利要求3或4所述的画作问答方法,其中,根据所述命名实体确定所述命名实体对应的待识别向量,包括:The painting question answering method according to claim 3 or 4, wherein determining the vector to be recognized corresponding to the named entity according to the named entity comprises:通过深度学习模型,根据所述命名实体确定所述命名实体对应的待识别向量。Through the deep learning model, the vector to be recognized corresponding to the named entity is determined according to the named entity.根据权利要求3-5中任一所述的画作问答方法,其中,基于所述待识别向量,将满足要求的标准特征向量的意图确定为所述文本信息的当前意图,包括:The painting question answering method according to any one of claims 3-5, wherein, based on the vector to be recognized, determining the intent of the standard feature vector that meets the requirements as the current intent of the text information comprises:将与所述待识别向量的相似度最大的标准特征向量的意图确定为所述文本信息的当前意图。The intent of the standard feature vector with the greatest similarity to the vector to be recognized is determined as the current intent of the text information.根据权利要求1-6中任一所述的画作问答方法,其中,所述文本信息为所述用户直接输入的文本内容,或者为识别所述用户输入的语音信息以后得到的文本内容。The painting question answering method according to any one of claims 1 to 6, wherein the text information is text content directly input by the user, or text content obtained after recognizing the voice information input by the user.根据权利要求1-7中任一项所述的画作问答方法,其中,获取来自所述显示终端的文本信息,包括:The painting question answering method according to any one of claims 1-7, wherein obtaining text information from the display terminal comprises:接收来自所述显示终端的请求数据,解析所述请求数据以获取所述文本信息。Receive request data from the display terminal, and parse the request data to obtain the text information.根据权利要求1-7中任一项所述的画作问答方法,还包括:The painting question answering method according to any one of claims 1-7, further comprising:识别来自所述显示终端的语音信息,以得到所述文本信息。Recognizing the voice information from the display terminal to obtain the text information.根据权利要求1-9中任一项所述的画作问答方法,还包括:The painting question answering method according to any one of claims 1-9, further comprising:将所述回答数据发送至所述显示终端。The answer data is sent to the display terminal.一种画作问答装置,包括:A question and answer device for paintings, including:文本信息获取电路,被配置为获取来自显示终端的文本信息,以及获取所述显示终端的当前对话状态;The text information acquisition circuit is configured to acquire text information from the display terminal and acquire the current dialogue state of the display terminal;当前意图获取电路,被配置为对所述文本信息进行语义理解以获取用户的当前意图;The current intention acquisition circuit is configured to perform semantic understanding of the text information to acquire the current intention of the user;目标状态确定电路,被配置为根据所述当前对话状态和所述当前意图确定目标对话状态;A target state determination circuit configured to determine a target dialogue state according to the current dialogue state and the current intention;回答数据获取电路,被配置为根据所述目标对话状态获取所述文本信息对应的回答数据。The answer data acquisition circuit is configured to acquire answer data corresponding to the text information according to the target dialogue state.根据权利要求11所述的画作问答装置,其中,所述当前意图获取电路包括:The painting question answering device according to claim 11, wherein the current intention acquisition circuit comprises:命名实体识别电路,被配置为识别所述文本信息的命名实体;A named entity recognition circuit configured to recognize a named entity of the text information;识别向量确定电路,被配置为根据所述命名实体确定所述命名实体对应的待识别向量;A recognition vector determining circuit, configured to determine a vector to be recognized corresponding to the named entity according to the named entity;当前意图确定电路,被配置为基于所述待识别向量,将满足要求的标准特征向量的意图确定为所述文本信息的当前意图。The current intention determination circuit is configured to determine the intention of the standard feature vector meeting the requirements as the current intention of the text information based on the vector to be recognized.一种画作问答系统,包括显示终端和问答服务器;其中,A question and answer system for paintings, including a display terminal and a question and answer server; among them,所述显示终端被配置为将请求数据发送给所述问答服务器;The display terminal is configured to send request data to the question and answer server;所述问答服务器被配置为基于所述请求数据获取来自所述显示终端的文本信息,以及获取所述显示终端的当前对话状态,并对所述文本信息进行语义理解以获取用户的当前意图;根据所述当前对话状态和所述当前意图确定目标对话状态;以及根据所述目标对话状态获取所述文本信息对应的回答数 据;The question and answer server is configured to obtain text information from the display terminal based on the request data, and obtain the current dialogue state of the display terminal, and perform semantic understanding of the text information to obtain the current intention of the user; Determining a target dialogue state by the current dialogue state and the current intention; and obtaining answer data corresponding to the text information according to the target dialogue state;所述显示终端还被配置为接收所述回答数据,并显示基于所述回答数据的画作数据。The display terminal is also configured to receive the answer data and display painting data based on the answer data.根据权利要求13所述的画作问答系统,其中,所述回答数据包括画作数据或者用于提取所述画作数据的提取信息。The painting question answering system according to claim 13, wherein the answer data includes painting data or extraction information for extracting the painting data.根据权利要求14所述的画作问答系统,还包括语音识别服务器;The painting question answering system according to claim 14, further comprising a voice recognition server;其中,所述语音识别服务器与所述显示终端信号连接,被配置为识别来自所述显示终端的语音信息,以获得所述文本信息。Wherein, the voice recognition server is signally connected to the display terminal, and is configured to recognize voice information from the display terminal to obtain the text information.根据权利要求14或15所述的画作问答系统,其中,所述问答服务器包括WEB服务器和语义服务器;所述WEB服务器分别与所述显示终端和所述语义服务器信号连接;The painting question and answer system according to claim 14 or 15, wherein the question and answer server comprises a WEB server and a semantic server; the WEB server is signally connected to the display terminal and the semantic server respectively;所述WEB服务器被配置为接收来自所述显示终端的请求数据,解析所述请求数据以获取所述文本信息,并将所述文本信息发送给所述语义服务器,以及将所述语义服务器根据所述文本信息获取的所述回答数据经由所述WEB服务器返回给所述显示终端;以及The WEB server is configured to receive request data from the display terminal, parse the request data to obtain the text information, send the text information to the semantic server, and send the semantic server according to the The answer data obtained by the text information is returned to the display terminal via the WEB server; and所述语义服务器被配置为接收来自所述WEB服务器的文本信息,获取所述显示终端的当前对话状态,并对所述文本信息进行语义理解以获取用户的当前意图;根据所述当前对话状态和所述当前意图确定目标对话状态;根据所述目标对话状态获取所述文本信息对应的回答数据;和将所述回答数据发送至所述WEB服务器。The semantic server is configured to receive text information from the WEB server, obtain the current dialogue state of the display terminal, and perform semantic understanding of the text information to obtain the current intention of the user; according to the current dialogue state and The current intention determines a target dialogue state; obtains answer data corresponding to the text information according to the target dialogue state; and sends the answer data to the WEB server.根据权利要求14-16中任一项所述的画作问答系统,还包括存储画作数据的数据库服务器,The painting question answering system according to any one of claims 14-16, further comprising a database server storing painting data,其中,所述数据库服务器配置为存储所述画作数据。Wherein, the database server is configured to store the painting data.根据权利要求17所述的画作问答系统,其中,所述数据库服务器与所述问答服务器信号连接,被配置为响应于所述问答服务器的请求信息,将所述请求信息对应的画作数据返回给所述问答服务器,所述问答服务器将所述画作数据作为所述回答数据发送给所述显示终端。The painting question and answer system according to claim 17, wherein the database server is in signal connection with the question and answer server, and is configured to respond to the request information of the question and answer server and return the painting data corresponding to the request information to the The question and answer server is configured to send the painting data as the answer data to the display terminal.根据权利要求17所述的画作问答系统,其中,所述数据库服务器与所述显示终端信号连接,The painting question answering system according to claim 17, wherein the database server is in signal connection with the display terminal,所述显示终端配置为使用所述提取信息从所述数据库服务器中提取所述 画作数据,The display terminal is configured to use the extraction information to extract the painting data from the database server,所述数据库服务器配置为响应于所述显示终端发送的所述提取信息,并将所述提取信息对应的画作数据发送给所述显示终端。The database server is configured to respond to the extraction information sent by the display terminal, and send painting data corresponding to the extraction information to the display terminal.一种画作问答装置,包括:A question and answer device for paintings, including:处理器;processor;存储器,包括一个或多个计算机程序模块;The memory includes one or more computer program modules;其中,所述一个或多个计算机程序模块被存储在所述存储器中并被配置为由所述处理器执行,所述一个或多个计算机程序模块包括用于实现权利要求1-10中任一项所述的画作问答方法的指令。Wherein, the one or more computer program modules are stored in the memory and are configured to be executed by the processor, and the one or more computer program modules comprise any one of claims 1-10 Instructions for the question and answer method of paintings described in the item.一种可读存储介质,其上存储有计算机指令,其中,所述计算机指令被处理器执行时实现权利要求1-10中任一项所述的画作问答方法。A readable storage medium having computer instructions stored thereon, wherein when the computer instructions are executed by a processor, the painting question answering method according to any one of claims 1-10 is realized.
PCT/CN2020/0767802019-03-052020-02-26Painting question answering method and device, painting question answering system, and readable storage mediumCeasedWO2020177592A1 (en)

Applications Claiming Priority (2)

Application NumberPriority DateFiling DateTitle
CN201910163293.8ACN111666006B (en)2019-03-052019-03-05Method and device for drawing question and answer, drawing question and answer system and readable storage medium
CN201910163293.82019-03-05

Publications (1)

Publication NumberPublication Date
WO2020177592A1true WO2020177592A1 (en)2020-09-10

Family

ID=72338172

Family Applications (1)

Application NumberTitlePriority DateFiling Date
PCT/CN2020/076780CeasedWO2020177592A1 (en)2019-03-052020-02-26Painting question answering method and device, painting question answering system, and readable storage medium

Country Status (2)

CountryLink
CN (1)CN111666006B (en)
WO (1)WO2020177592A1 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN112183075A (en)*2020-10-102021-01-05网易(杭州)网络有限公司Method and device for extracting slots in conversation, electronic equipment and storage medium
CN112231556A (en)*2020-10-132021-01-15中国平安人寿保险股份有限公司User image drawing method, device, equipment and medium based on conversation scene
CN112288584A (en)*2020-10-292021-01-29泰康保险集团股份有限公司Insurance application processing method and device, computer readable medium and electronic equipment
CN112365892A (en)*2020-11-102021-02-12杭州大搜车汽车服务有限公司Man-machine interaction method, device, electronic device and storage medium
CN113158690A (en)*2021-03-152021-07-23京东数科海益信息科技有限公司Testing method and device for conversation robot
CN114049973A (en)*2021-11-152022-02-15阿里巴巴(中国)有限公司 Dialogue quality inspection method, electronic device, computer storage medium and program product
CN114189740A (en)*2021-10-272022-03-15杭州摸象大数据科技有限公司Video synthesis dialogue construction method and device, computer equipment and storage medium
CN114663114A (en)*2022-03-222022-06-24平安科技(深圳)有限公司Session management method, computer and storage medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN106164909A (en)*2014-04-012016-11-23微软技术许可有限责任公司The task of natural language input completes
CN106663129A (en)*2016-06-292017-05-10深圳狗尾草智能科技有限公司A sensitive multi-round dialogue management system and method based on state machine context
CN107193978A (en)*2017-05-262017-09-22武汉泰迪智慧科技有限公司A kind of many wheel automatic chatting dialogue methods and system based on deep learning
CN107273477A (en)*2017-06-092017-10-20北京光年无限科技有限公司A kind of man-machine interaction method and device for robot
US20180060303A1 (en)*2016-08-242018-03-01Microsoft Technology Licensing, LlcMulti-turn cross-domain natural language understanding systems, building platforms, and methods
CN110334201A (en)*2019-07-182019-10-15中国工商银行股份有限公司A kind of intension recognizing method, apparatus and system
CN110532361A (en)*2019-08-092019-12-03深圳追一科技有限公司Recognition methods, device, computer equipment and the storage medium that user is intended to

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN101075301A (en)*2007-06-282007-11-21腾讯科技(深圳)有限公司Virtual pet system method and device for chatting with virtual pet
AU2015236010A1 (en)*2014-03-262016-11-10Unanimous A.I. LLCMethods and systems for real-time closed-loop collaborative intelligence
US9965705B2 (en)*2015-11-032018-05-08Baidu Usa LlcSystems and methods for attention-based configurable convolutional neural networks (ABC-CNN) for visual question answering
US20180131642A1 (en)*2016-11-042018-05-10Microsoft Technology Licensing, LlcConversation runtime
US11157490B2 (en)*2017-02-162021-10-26Microsoft Technology Licensing, LlcConversational virtual assistant
CN107301213A (en)*2017-06-092017-10-27腾讯科技(深圳)有限公司Intelligent answer method and device
CN107357875B (en)*2017-07-042021-09-10北京奇艺世纪科技有限公司Voice search method and device and electronic equipment
CN107943860B (en)*2017-11-082020-10-27北京奇艺世纪科技有限公司Model training method, text intention recognition method and text intention recognition device
CN108345692B (en)*2018-03-162020-07-31北京京东尚科信息技术有限公司Automatic question answering method and system
CN108804532B (en)*2018-05-032020-06-26腾讯科技(深圳)有限公司Query intention mining method and device and query intention identification method and device
US10305826B1 (en)*2018-05-032019-05-28Progressive Casualty Insurance CompanyIntelligent conversational systems
CN108733779B (en)*2018-05-042022-10-04百度在线网络技术(北京)有限公司Text matching method and device
CN108897867B (en)*2018-06-292021-02-09北京百度网讯科技有限公司Data processing method, device, server and medium for knowledge question answering

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN106164909A (en)*2014-04-012016-11-23微软技术许可有限责任公司The task of natural language input completes
CN106663129A (en)*2016-06-292017-05-10深圳狗尾草智能科技有限公司A sensitive multi-round dialogue management system and method based on state machine context
US20180060303A1 (en)*2016-08-242018-03-01Microsoft Technology Licensing, LlcMulti-turn cross-domain natural language understanding systems, building platforms, and methods
CN107193978A (en)*2017-05-262017-09-22武汉泰迪智慧科技有限公司A kind of many wheel automatic chatting dialogue methods and system based on deep learning
CN107273477A (en)*2017-06-092017-10-20北京光年无限科技有限公司A kind of man-machine interaction method and device for robot
CN110334201A (en)*2019-07-182019-10-15中国工商银行股份有限公司A kind of intension recognizing method, apparatus and system
CN110532361A (en)*2019-08-092019-12-03深圳追一科技有限公司Recognition methods, device, computer equipment and the storage medium that user is intended to

Cited By (12)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN112183075A (en)*2020-10-102021-01-05网易(杭州)网络有限公司Method and device for extracting slots in conversation, electronic equipment and storage medium
CN112183075B (en)*2020-10-102023-06-30网易(杭州)网络有限公司Method and device for extracting slots in conversation, electronic equipment and storage medium
CN112231556A (en)*2020-10-132021-01-15中国平安人寿保险股份有限公司User image drawing method, device, equipment and medium based on conversation scene
CN112231556B (en)*2020-10-132023-07-25中国平安人寿保险股份有限公司User image drawing method, device, equipment and medium based on dialogue scene
CN112288584A (en)*2020-10-292021-01-29泰康保险集团股份有限公司Insurance application processing method and device, computer readable medium and electronic equipment
CN112288584B (en)*2020-10-292024-05-17泰康保险集团股份有限公司Insurance report processing method and device, computer readable medium and electronic equipment
CN112365892A (en)*2020-11-102021-02-12杭州大搜车汽车服务有限公司Man-machine interaction method, device, electronic device and storage medium
CN113158690A (en)*2021-03-152021-07-23京东数科海益信息科技有限公司Testing method and device for conversation robot
CN113158690B (en)*2021-03-152024-05-17京东科技信息技术有限公司Test method and device of conversation robot
CN114189740A (en)*2021-10-272022-03-15杭州摸象大数据科技有限公司Video synthesis dialogue construction method and device, computer equipment and storage medium
CN114049973A (en)*2021-11-152022-02-15阿里巴巴(中国)有限公司 Dialogue quality inspection method, electronic device, computer storage medium and program product
CN114663114A (en)*2022-03-222022-06-24平安科技(深圳)有限公司Session management method, computer and storage medium

Also Published As

Publication numberPublication date
CN111666006B (en)2022-01-14
CN111666006A (en)2020-09-15

Similar Documents

PublicationPublication DateTitle
WO2020177592A1 (en)Painting question answering method and device, painting question answering system, and readable storage medium
US10460040B2 (en)Language model using reverse translations
CN105592343B (en)Display device and method for question and answer
US11024300B2 (en)Electronic device and control method therefor
CN107612814A (en)Method and apparatus for generating candidate's return information
US20180239812A1 (en)Method and apparatus for processing question-and-answer information, storage medium and device
CN107918634A (en)Intelligent answer method, apparatus and computer-readable recording medium
CN107222757A (en)A kind of voice search method, set top box, storage medium, server and system
WO2016206210A1 (en)Information pushing method and device
CN103019407B (en)Input method application method, automatic question answering processing method, electronic equipment and server
WO2018153130A1 (en)Translation method and apparatus
CN114528588B (en) Cross-modal privacy semantic representation method, device, equipment and storage medium
CN117312641A (en)Method, device, equipment and storage medium for intelligently acquiring information
WO2019109663A1 (en)Cross-language search method and apparatus, and apparatus for cross-language search
JP2018072508A (en) Voice input device and voice input method
CN114637831A (en) Data query method and related equipment based on semantic analysis
CN109640142B (en) A content recommendation method and device, device, and storage medium
CN117236340A (en) Question and answer methods, devices, equipment and media
WO2025026402A1 (en)Question answering method and apparatus, electronic device and storage medium
CN107608799A (en) A method, device and storage medium for executing interactive instructions
CN113570687A (en)File processing method and device
WO2023061276A1 (en)Data recommendation method and apparatus, electronic device, and storage medium
CN110895924B (en)Method and device for reading document content aloud, electronic equipment and readable storage medium
TWI682386B (en)Integrated speech recognition systems and methods
CN113435523B (en) Method, device, electronic device and storage medium for predicting content click-through rate

Legal Events

DateCodeTitleDescription
121Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number:20765986

Country of ref document:EP

Kind code of ref document:A1

NENPNon-entry into the national phase

Ref country code:DE

122Ep: pct application non-entry in european phase

Ref document number:20765986

Country of ref document:EP

Kind code of ref document:A1

32PNEp: public notification in the ep bulletin as address of the adressee cannot be established

Free format text:NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 06.05.2022)


[8]ページ先頭

©2009-2025 Movatter.jp