













技术领域technical field
本申请涉及计算机技术领域,特别是涉及一种数据处理方法和装置、一种音箱设备、一种电子设备和一种存储介质。The present application relates to the field of computer technology, and in particular, to a data processing method and apparatus, a sound box device, an electronic device, and a storage medium.
背景技术Background technique
音箱指的是一种可将音频信号变换为声音的设备。其中,音箱自带功率放大器,对音频信号进行放大处理后由音箱本身回放出声音,使其声音变大。用户通常可在电视等影音设备外接音箱,从而输出外放的声音。A speaker refers to a device that converts audio signals into sound. Among them, the speaker has its own power amplifier. After amplifying the audio signal, the speaker itself plays back the sound to make the sound louder. Users can usually connect external speakers to audio-visual equipment such as TVs to output external sound.
音箱通常是通过数据线连接设备,有些音箱也支持蓝牙方式和设备相连,但是往往需要先匹配蓝牙才能建立连接,然后音箱作为设备的音频输出部件使用。The speaker is usually connected to the device through a data cable, and some speakers also support Bluetooth connection to the device, but it is often necessary to match the Bluetooth to establish a connection, and then the speaker is used as the audio output component of the device.
发明内容SUMMARY OF THE INVENTION
本申请实施例提供了一种数据处理方法,以使音箱设备能够便捷的与移动终端连接交互。The embodiment of the present application provides a data processing method, so that the speaker device can conveniently connect and interact with the mobile terminal.
相应的,本申请实施例还提供了一种数据处理装置、一种音箱设备、一种电子设备以及一种存储介质,用以保证上述方法的实现及应用。Correspondingly, the embodiments of the present application further provide a data processing apparatus, a sound box device, an electronic device, and a storage medium, so as to ensure the implementation and application of the above method.
为了解决上述问题,本申请实施例公开了一种数据处理方法,应用于音箱设备,所述方法包括:建立与移动终端的连接;发送第一指令给所述移动终端,所述移动终端上具有与所述音箱设备对应的应用程序;通过与所述移动终端的数据交互,在所述音箱设备上输出所述应用程序上显示信息对应的音频数据。In order to solve the above problem, an embodiment of the present application discloses a data processing method, which is applied to a speaker device. The method includes: establishing a connection with a mobile terminal; sending a first instruction to the mobile terminal, and the mobile terminal has a An application program corresponding to the speaker device; through data interaction with the mobile terminal, output audio data corresponding to the information displayed on the application program on the speaker device.
本申请实施例还公开了一种数据处理方法,应用于移动终端,所述方法包括:与音箱设备建立连接;接收所述音箱设备的第一指令,依据所述第一指令运行与所述音箱设备对应的应用程序;依据所述应用程序的显示信息,与所述音箱设备进行数据交互,以在所述音箱设备上输出所述应用程序上显示信息对应的音频数据。The embodiment of the present application also discloses a data processing method, which is applied to a mobile terminal. The method includes: establishing a connection with a speaker device; receiving a first instruction of the speaker device, and running and communicating with the speaker according to the first instruction An application program corresponding to the device; according to the display information of the application program, data interaction is performed with the speaker device to output audio data corresponding to the information displayed on the application program on the speaker device.
本申请实施例还公开了一种数据处理装置,应用于音箱设备,所述装置包括:连接模块,用于建立与所述移动终端的连接;指令发送模块,用于发送第一指令给所述移动终端,所述移动终端上具有与所述音箱设备对应的应用程序;交互输出模块,用于通过与所述移动终端的数据交互,在所述音箱设备上输出所述应用程序上显示信息对应的音频数据。The embodiment of the present application further discloses a data processing apparatus, which is applied to a speaker device, and the apparatus includes: a connection module for establishing a connection with the mobile terminal; an instruction sending module for sending a first instruction to the mobile terminal A mobile terminal, which has an application program corresponding to the speaker device; an interactive output module for outputting information corresponding to the application program on the speaker device through data interaction with the mobile terminal audio data.
本申请实施例还公开了一种数据处理装置,应用于移动终端,所述装置包括:连接建立模块,用于与音箱设备建立连接;指令接收模块,用于接收所述音箱设备的第一指令,依据所述第一指令运行与所述音箱设备对应的应用程序;交互显示模块,用于依据所述应用程序的显示信息,与所述音箱设备进行数据交互,以在所述音箱设备上输出所述应用程序上显示信息对应的音频数据。The embodiment of the present application also discloses a data processing apparatus, which is applied to a mobile terminal, and the apparatus includes: a connection establishing module for establishing a connection with a speaker device; an instruction receiving module for receiving a first instruction of the speaker device , run the application program corresponding to the speaker device according to the first instruction; the interactive display module is used for data interaction with the speaker device according to the display information of the application program, so as to output on the speaker device Audio data corresponding to the information is displayed on the application program.
本申请实施例还公开了一种音箱设备,包括:处理器;和存储器,其上存储有可执行代码,当所述可执行代码被执行时,使得所述处理器执行如本申请实施例中一个或多个所述的数据处理方法。The embodiment of the present application also discloses a sound box device, including: a processor; and a memory, on which executable codes are stored, and when the executable codes are executed, the processor is made to execute as in the embodiments of the present application. One or more of the described data processing methods.
本申请实施例还公开了一个或多个机器可读介质,其上存储有可执行代码,当所述可执行代码被执行时,使得处理器执行如本申请实施例中一个或多个所述的数据处理方法。The embodiments of the present application further disclose one or more machine-readable media on which executable codes are stored, and when the executable codes are executed, the processors are caused to execute the execution of one or more of the embodiments of the present application. data processing method.
本申请实施例还公开了一种电子设备,包括:处理器;和存储器,其上存储有可执行代码,当所述可执行代码被执行时,使得所述处理器执行如本申请实施例中一个或多个所述的数据处理方法。The embodiment of the present application also discloses an electronic device, including: a processor; and a memory, on which executable code is stored, when the executable code is executed, the processor is made to execute as in the embodiment of the present application. One or more of the described data processing methods.
本申请实施例还公开了一个或多个机器可读介质,其上存储有可执行代码,当所述可执行代码被执行时,使得处理器执行如本申请实施例中一个或多个所述的数据处理方法。The embodiments of the present application further disclose one or more machine-readable media on which executable codes are stored, and when the executable codes are executed, the processors are caused to execute the execution of one or more of the embodiments of the present application. data processing method.
本申请实施例还公开了一种数据处理方法,应用于不具备屏幕的第一智能设备,所述方法包括:建立与第二智能设备的连接,所述第二智能设备具备屏幕;所述第一智能设备输出音频数据;通过所述第二智能设备的屏幕,输出与所述音频数据对应的显示信息。The embodiment of the present application also discloses a data processing method, which is applied to a first smart device without a screen. The method includes: establishing a connection with a second smart device, the second smart device having a screen; the first smart device having a screen; A smart device outputs audio data; and display information corresponding to the audio data is output through the screen of the second smart device.
本申请实施例还公开了一种数据处理装置,应用于不具备屏幕的第一智能设备,所述装置包括:设备连接模块,用于建立与第二智能设备的连接,所述第二智能设备具备屏幕;输出模块,用于所述第一智能设备输出音频数据;通过所述第二智能设备的屏幕,输出与所述音频数据对应的显示信息。The embodiment of the present application further discloses a data processing apparatus, which is applied to a first smart device without a screen, and the apparatus includes: a device connection module for establishing a connection with a second smart device, the second smart device A screen is provided; an output module is used for the first smart device to output audio data; and through the screen of the second smart device, the display information corresponding to the audio data is output.
本申请实施例还公开了一种电子设备,包括:处理器;和存储器,其上存储有可执行代码,当所述可执行代码被执行时,使得所述处理器执行如本申请实施例所述的数据处理方法。The embodiments of the present application further disclose an electronic device, including: a processor; and a memory, on which executable codes are stored, and when the executable codes are executed, the processor is caused to execute as described in the embodiments of the present application. the data processing method described.
本申请实施例还公开了一个或多个机器可读介质,其上存储有可执行代码,当所述可执行代码被执行时,使得处理器执行如本申请实施例所述的数据处理方法。The embodiments of the present application further disclose one or more machine-readable media, on which executable codes are stored, and when the executable codes are executed, the processors are made to execute the data processing methods described in the embodiments of the present application.
与现有技术相比,本申请实施例包括以下优点:Compared with the prior art, the embodiments of the present application include the following advantages:
在本申请实施例中,音箱设备可以建立与该移动终端的连接,使得音箱设备和移动终端能够便捷的连接,然后音箱设备可发送第一指令给移动终端,可在移动终端中运行与该音箱设备对应的应用程序,使得移动终端能够作为音箱设备的显示器,通过与所述移动终端的数据交互,应用程序的显示信息和音箱设备输出的音频数据彼此响应,音箱设备在为用户提供优质音效的同时,还能够通过连接的移动终端为用户显示所需的信息。In the embodiment of the present application, the speaker device can establish a connection with the mobile terminal, so that the speaker device and the mobile terminal can be conveniently connected, and then the speaker device can send the first instruction to the mobile terminal, and the speaker device can run in the mobile terminal with the speaker The application program corresponding to the device enables the mobile terminal to act as the display of the speaker device. Through data interaction with the mobile terminal, the display information of the application program and the audio data output by the speaker device respond to each other, and the speaker device is in the process of providing users with high-quality sound effects. At the same time, the required information can also be displayed for the user through the connected mobile terminal.
附图说明Description of drawings
图1是本申请实施例中一种数据处理系统的示意图;1 is a schematic diagram of a data processing system in an embodiment of the present application;
图2是本申请的一种数据处理方法实施例音箱设备侧的步骤流程图;2 is a flow chart of steps on the speaker device side of a data processing method embodiment of the present application;
图3是本申请的一种数据处理方法实施例移动终端侧的步骤流程图;FIG. 3 is a flow chart of steps on the mobile terminal side according to an embodiment of a data processing method of the present application;
图4是本申请实施例的一种数据处理方法的交互示意图;4 is an interactive schematic diagram of a data processing method according to an embodiment of the present application;
图5是本申请实施例的另一种数据处理方法的交互示意图;5 is an interactive schematic diagram of another data processing method according to an embodiment of the present application;
图6是本申请实施例的又一种数据处理方法的交互示意图;6 is an interactive schematic diagram of another data processing method according to an embodiment of the present application;
图7是本申请实施例的一种无线充电方法的交互示意图;FIG. 7 is an interactive schematic diagram of a wireless charging method according to an embodiment of the present application;
图8是本申请实施例的再一种数据处理方法的交互示意图;8 is an interactive schematic diagram of still another data processing method according to an embodiment of the present application;
图9是本申请的一种数据处理装置实施例的结构框图;9 is a structural block diagram of an embodiment of a data processing apparatus of the present application;
图10是本申请的一种数据处理装置可选实施例的结构框图;10 is a structural block diagram of an optional embodiment of a data processing apparatus according to the present application;
图11是本申请的另一种数据处理装置实施例的结构框图;11 is a structural block diagram of another embodiment of a data processing apparatus of the present application;
图12是本申请的另一种数据处理装置可选实施例的结构框图;12 is a structural block diagram of another optional embodiment of a data processing apparatus of the present application;
图13是本申请的又一种数据处理装置实施例的结构框图;13 is a structural block diagram of another embodiment of a data processing apparatus of the present application;
图14是本申请一实施例提供的装置的结构示意图。FIG. 14 is a schematic structural diagram of an apparatus provided by an embodiment of the present application.
具体实施方式Detailed ways
为使本申请的上述目的、特征和优点能够更加明显易懂,下面结合附图和具体实施方式对本申请作进一步详细的说明。In order to make the above objects, features and advantages of the present application more clearly understood, the present application will be described in further detail below with reference to the accompanying drawings and specific embodiments.
本申请实施例中,音箱设备是音箱的升级产物,也可称为智能音箱。该音箱设备除了音箱中常见的功率放大器、扬声器等音频输出部件外,还可包括麦克风等音频输入部件和无线网络模块,该无线网络模块可包括上网模块如wifi芯片,蓝牙模块如蓝牙芯片等,也可为其他无线连接技术相关的模块。从而该音箱设备在提供基本的音频输出功能外,还可作为语音上网的工具,如点播歌曲、上网购物,或是了解天气预报,此外也可作为物联网设备进行家居的智能控制,控制各种家居设备等。移动终端指的是可在移动中使用的计算机设备,如包括手机、平板电脑等。In the embodiments of the present application, the speaker device is an upgraded product of the speaker, and may also be referred to as a smart speaker. In addition to the common audio output components such as power amplifiers and speakers in speakers, the speaker device can also include audio input components such as microphones and wireless network modules. The wireless network module can include Internet access modules such as wifi chips, Bluetooth modules such as Bluetooth chips, etc. It can also be modules related to other wireless connection technologies. Therefore, in addition to providing basic audio output functions, the speaker device can also be used as a tool for voice Internet access, such as on-demand songs, online shopping, or understanding the weather forecast. household equipment, etc. A mobile terminal refers to a computer device that can be used on the move, such as a mobile phone, a tablet computer, and the like.
参照图1,示出了本申请实施例中一种数据处理系统的示意图。Referring to FIG. 1 , a schematic diagram of a data processing system in an embodiment of the present application is shown.
该数据处理系统中包括音箱设备10和移动终端20,其中,音箱设备10中可包括传感器,如压力传感器等,使得音箱设备能够感知到与移动终端的接触,从而在将移动终端放置到音箱设备时,实现音箱设备和移动终端的互连,又如红外传感器,使得音箱设备能够感知到移动终端的接近,从而自动与移动终端连接。The data processing system includes a
在移动终端中可安装与该移动终端向对应的应用程序,从而在音箱设备与移动终端连接的情况下,音箱设备可与移动终端的应用程序交互,应用程序作为音箱设备的面部或显示器等显示部件,相对应的,音箱设备作为该移动终端的音频输入/输出部件,实现音频和显示的互动。An application program corresponding to the mobile terminal can be installed in the mobile terminal, so that when the speaker device is connected to the mobile terminal, the speaker device can interact with the application program of the mobile terminal, and the application program is displayed as the face or display of the speaker device. component, correspondingly, the speaker device acts as the audio input/output component of the mobile terminal to realize the interaction between audio and display.
参照图2,示出了本申请的一种数据处理方法实施例音箱设备侧的步骤流程图。Referring to FIG. 2 , a flowchart of steps on the side of a speaker device according to an embodiment of a data processing method of the present application is shown.
步骤202,建立与所述移动终端的连接。
音箱设备中设置有传感器,可检测到音箱设备和其他设备的接触、接近等,从而在将移动终端放置到音箱上时,音箱设备可以基于传感器感知到移动终端的接触,音箱设备与该移动终端建立连接。The speaker device is provided with a sensor, which can detect the contact, proximity, etc. of the speaker device and other devices, so that when the mobile terminal is placed on the speaker, the speaker device can sense the contact of the mobile terminal based on the sensor, and the speaker device and the mobile terminal. establish connection.
本申请实施例中,移动终端和音箱设备可采用多种无线技术实现无线方式连接,例如通过蓝牙(Bluetooth)技术,近场通信(Near Field Communication,NFC)技术、wifi技术等。如在一种示例中,音箱设备感知到移动终端接触时,可发送连接指令给移动终端,使得移动终端与音箱设备建立连接。In the embodiments of the present application, the mobile terminal and the speaker device may use various wireless technologies to realize wireless connection, such as Bluetooth (Bluetooth) technology, Near Field Communication (Near Field Communication, NFC) technology, wifi technology, and the like. For example, when the sound box device senses the contact of the mobile terminal, it can send a connection instruction to the mobile terminal, so that the mobile terminal can establish a connection with the sound box device.
步骤204,发送第一指令给所述移动终端,所述移动终端上具有与所述音箱设备对应的应用程序。Step 204: Send a first instruction to the mobile terminal, and the mobile terminal has an application program corresponding to the speaker device.
在音箱设备和移动终端连接后,音箱设备可生成第一指令,所述移动终端上具有与所述音箱设备对应的应用程序,则移动终端可基于该第一指令运行与该音箱设备对应的应用程序。所述第一指令用于指示所述移动终端与音箱设备连接成功。After the speaker device and the mobile terminal are connected, the speaker device can generate a first instruction, the mobile terminal has an application program corresponding to the speaker device, and the mobile terminal can run the application corresponding to the speaker device based on the first instruction program. The first instruction is used to indicate that the mobile terminal is successfully connected with the speaker device.
移动终端接收到第一指令后,可基于该第一指令确定音箱设备对应的应用程序,如该第一指令中包括应用程序的应用标识,又如该第一指令中包括音箱设备的设备标识,连接成功标识等标识信息,然后移动终端可依据该标识信息查询匹配的应用程序的应用标识等,在确定出应用程序后,可以判断该应用程序是否已运行,若移动终端上未运行该应用程序,则可运行该应用程序,在应用程序运行后,可在与所述音箱设备对应的应用程序上显示连接成功的提示信息,通知用户该应用程序与音箱设备已连接可执行交互。从而在音箱设备和移动终端上均可显示连接成功的提示信息,便于用户执行后续的操作。After receiving the first instruction, the mobile terminal can determine the application program corresponding to the speaker device based on the first instruction. For example, the first instruction includes the application identifier of the application program, and the first instruction includes the device identifier of the speaker device. Identification information such as a successful connection identification, and then the mobile terminal can query the application identification of the matching application program according to the identification information, etc. After determining the application program, it can determine whether the application program has been running, if the application program is not running on the mobile terminal. , the application can be run, and after the application is running, a prompt message of successful connection can be displayed on the application corresponding to the speaker device, notifying the user that the application and the speaker device have been connected to perform interaction. Therefore, prompt information of successful connection can be displayed on both the speaker device and the mobile terminal, which is convenient for the user to perform subsequent operations.
步骤206,通过与所述移动终端的数据交互,在所述音箱设备上输出所述应用程序上显示信息对应的音频数据。Step 206: Output audio data corresponding to the information displayed on the application program on the speaker device through data interaction with the mobile terminal.
移动终端中启动应用程序后,音箱设备和应用程序可互连,也可与网络侧的服务端连接。其中,音箱设备和应用程序可登录同一用户的账户,或者登录匹配的账户,音箱设备和移动终端可进行数据交互,对于一端的消息,另一端可以匹配响应,从而音箱设备作为音频输入/输出端,提供音频的输入、输出,移动终端结合应用程序作为显示端,提供显示信息。After starting the application in the mobile terminal, the speaker device and the application can be interconnected, or connected to the server on the network side. Among them, the speaker device and the application can log in to the same user's account, or log in to a matching account, and the speaker device and the mobile terminal can interact with data. For a message from one end, the other end can match the response, so that the speaker device acts as an audio input/output terminal , providing audio input and output, and the mobile terminal combined with the application program as the display terminal to provide display information.
本申请实施例中,音箱设备可移动终端可进行数据交互,应用程序的显示信息和音箱设备的音频数据彼此响应,从而在音箱设备上输出所述应用程序上显示信息对应的音频数据,以及在应用程度上显示音频数据对应的显示信息。例如音箱设备输出天气相关的音频数据,应用程序可显示对应天气的预报页面;又如应用程序可基于音箱设备输出的音频数据确定对应的表情进行显示,给用户提供聊天互动等。In the embodiment of the present application, the mobile terminal of the speaker device can perform data interaction, and the display information of the application program and the audio data of the speaker device respond to each other, so that the audio data corresponding to the information displayed on the application program is output on the speaker device, and the audio data corresponding to the display information on the application program is output on the speaker device. Display information corresponding to audio data at the application level. For example, the speaker device outputs weather-related audio data, and the application program can display the forecast page corresponding to the weather; another example is the application program can determine the corresponding expression based on the audio data output by the speaker device and display it, providing users with chat interaction, etc.
用户可通过说话指示所需的服务,从而音箱设备和移动终端可分别输出相应的响应消息,给用户提供所需的服务。因此在本申请一个可选实施例中,还可接收语音数据,依据所述语音数据确定对应的第二指令;将所述第二指令发送给所述移动终端,以使所述应用程序执行所述第二指令对应的操作。The user can instruct the desired service by speaking, so that the speaker device and the mobile terminal can output corresponding response messages respectively to provide the user with the desired service. Therefore, in an optional embodiment of the present application, voice data may also be received, and a corresponding second instruction may be determined according to the voice data; the second instruction may be sent to the mobile terminal, so that the application program executes all The operation corresponding to the second instruction is described.
一个示例中,音箱设备可接收语音数据,然后可由音箱设备对语音数据进行识别处理,对识别处理的识别结果进行分析,确定所需服务对应的第二指令,然后可将第二指令发送给服务端或移动终端处理。在另外一些示例中,音箱设备可发送语音数据给移动终端,然后移动终端的应用程序对接收的语音数据进行识别处理,依据识别结果进行分析,确定所需服务对应的第二指令,然后可将第二指令发送给服务端进行处理。服务端或移动终端的应用程序基于该第二指令可执行相应的处理,如搜索信息、确定输出信息等,从而能够确定出在应用程序上输出的显示信息,以及在音箱设备对应输出的音频数据,其中,该显示信息和音频数据对应。在另外的一些示例中,音箱设备将第二指令传输给应用程序后,应用程序也可确定第二指令对应的显示信息以及音频数据,从而基于应用程序输出显示信息,并反馈音频数据给音箱设备进行输出。In one example, the speaker device can receive voice data, and then the speaker device can recognize and process the voice data, analyze the recognition result of the recognition process, determine the second instruction corresponding to the required service, and then send the second instruction to the service. terminal or mobile terminal processing. In some other examples, the speaker device can send voice data to the mobile terminal, and then the application program of the mobile terminal can recognize and process the received voice data, analyze the recognition result, determine the second instruction corresponding to the required service, and then The second instruction is sent to the server for processing. The application program of the server or mobile terminal can perform corresponding processing based on the second instruction, such as searching for information, determining output information, etc., so as to determine the display information output on the application program and the corresponding output audio data on the speaker device. , wherein the display information corresponds to audio data. In some other examples, after the speaker device transmits the second instruction to the application, the application can also determine the display information and audio data corresponding to the second instruction, so as to output the display information based on the application, and feed back the audio data to the speaker device to output.
本申请实施例中,所述第二指令包括以下至少一种:充电指令、查询指令、交互指令。充电指令指的是用于指示充电的指令;查询指令指的是用于指示查询的指令;所述交互指令指的是用于指示执行交互的指令。In the embodiment of the present application, the second instruction includes at least one of the following: a charging instruction, a query instruction, and an interaction instruction. The charging instruction refers to an instruction for instructing charging; the query instruction refers to an instruction for instructing inquiry; and the interaction instruction refers to an instruction for instructing to perform interaction.
基于查询指令可为用户提供查询服务,其中查询包括对网络中各种服务信息的查询,如音乐、相声、脱口秀、故事、小说、评述、戏曲等娱乐内容的查询服务,时事新闻、财经资讯等新闻内容的查询服务,天气、时间、火车、航班等各项查询服务。上述查询服务的查询指令可基于音箱设备对接收的语音数据的识别确定,如可基于唤醒词+查询内容的方式分析得到,唤醒词可依据需求设置,如为“查”“查询”,也可为音箱名称或应用程序的名称等,查询内容为具体需要查询的内容。该查询指令可由音箱设备直接发送给服务端或应用程序,也可在应用程序接收并确定自身无法处理后转发给服务端,在服务端端该音箱设备和应用程序可基于账户进行绑定,从而对于所查询指令对应的响应消息,可同步反馈给音箱设备和应用程序,或者服务端反馈给应用程序,再由应用程序反馈给音箱设备,本申请实施例对此不做限制。其中,对于所反馈查询的响应消息,其中音频部分可由音箱设备解码输出,而其他部分可在终端设备的应用程序界面中同步显示输出,如显示故事的界面,显示音乐的专辑封面或音乐录影带(Music Video,MV),时事新闻、财经资讯等新闻内容的文字部分等,具体可依据需求和实际业务确定。Based on the query instructions, it can provide users with query services, including query services for various service information in the network, such as music, cross talk, talk shows, stories, novels, reviews, operas and other entertainment content query services, current affairs news, financial information and other news content query services, weather, time, trains, flights and other query services. The query command of the above query service can be determined based on the recognition of the received voice data by the speaker device. For example, it can be obtained by analyzing the wake-up word + query content. The wake-up word can be set according to requirements, such as "check" and "query". It is the name of the speaker or the name of the application, etc., and the query content is the content that needs to be queried. The query command can be sent directly by the speaker device to the server or application, or it can be forwarded to the server after the application receives and determines that it cannot be processed by itself. On the server, the speaker device and the application can be bound based on the account, so that The response message corresponding to the queried instruction can be fed back to the speaker device and the application synchronously, or the server can be fed back to the application, and then the application can be fed back to the speaker device, which is not limited in this embodiment of the present application. Among them, for the response message of the feedback query, the audio part can be decoded and output by the speaker device, and the other part can be displayed and output synchronously in the application program interface of the terminal device, such as the interface that displays the story, the album cover or the music video that displays the music. (Music Video, MV), the text part of news content such as current affairs news, financial information, etc., which can be determined according to needs and actual business.
对于交互指令可由音箱设备发送给服务端,或者音箱设备发送给应用程序,应用程序自行处理或发送给服务端处理,得到相应的交互响应消息。例如一种交互方式为聊天交互,用户可以随意的说话与音箱设备进行交互,音箱设备基于语音处理确定相应的语义信息,并寻找该语义信息对应的答复内容,然后返回给音箱设备进行语音输出。其中匹配该聊天的答复内容,可在应用程序的界面中显示相应的显示信息,如显示信息包括表情信息,表情信息指的是表达情感的显示信息,例如笑脸、哭脸、生气的表情等,使得用户得到对应的情感反馈,仿佛在与人聊天。在另外一些示例中,交互指令也可基于应用程序进行移动终端对应功能的交互,例如拨打电话、读写短信、查询时间、设置日程等,便于用户使用。For interactive instructions, the speaker device can be sent to the server, or the speaker device can be sent to the application, and the application can process it by itself or send it to the server for processing to obtain the corresponding interactive response message. For example, an interaction method is chat interaction. Users can speak at will to interact with the speaker device. The speaker device determines the corresponding semantic information based on speech processing, searches for the response content corresponding to the semantic information, and then returns it to the speaker device for voice output. The corresponding display information can be displayed in the interface of the application program that matches the reply content of the chat. For example, the display information includes expression information, and the expression information refers to the display information expressing emotions, such as smiling faces, crying faces, angry expressions, etc. Make users get corresponding emotional feedback, as if chatting with people. In some other examples, the interaction instruction can also interact with corresponding functions of the mobile terminal based on the application, such as making calls, reading and writing short messages, querying time, setting schedules, etc., which is convenient for users to use.
本申请实施例中,为了便于用户的使用,还可在音箱设备中内置无线充电线圈,使得该音箱设备还具有无线充电功能,通过该内置的无线充电线圈,为所述移动终端充电。一个示例中,音箱设备可在与移动终端接触并连接成功后,自动为移动终端充电,另一个示例中,用户可说出给手机充电等指示,从而音箱设备可基于语音识别分析得到充电指令,然后可启动音箱设备的充电功能,为放置在其上的移动设备充电。其中,无线充电可基于电磁感应式,通过磁场和电能转换的方式实现不需要数据线连接的充电。从而移动终端和音箱设备相连不但能够彼此响应交互,还能够无线充电。In the embodiment of the present application, in order to facilitate the use of the user, a wireless charging coil may also be built in the speaker device, so that the speaker device also has a wireless charging function, and the mobile terminal is charged through the built-in wireless charging coil. In one example, the speaker device can automatically charge the mobile terminal after it is in contact with the mobile terminal and successfully connected. In another example, the user can speak instructions such as charging the mobile phone, so that the speaker device can obtain the charging instruction based on speech recognition analysis. The charging function of the speaker device can then be activated to charge the mobile device placed on it. Among them, wireless charging can be based on electromagnetic induction, and can realize charging that does not require data line connection by means of magnetic field and electric energy conversion. Therefore, the connection of the mobile terminal and the speaker device can not only respond to and interact with each other, but also enable wireless charging.
基于上述实施例中,与音箱设备侧的实施例相对应,移动终端侧可采用如下步骤实现:Based on the above embodiment, corresponding to the embodiment on the speaker device side, the mobile terminal side can adopt the following steps to implement:
参照图3,示出了本申请的一种数据处理方法实施例移动终端侧的步骤流程图。Referring to FIG. 3 , a flow chart of steps on the mobile terminal side according to an embodiment of a data processing method of the present application is shown.
步骤302,与音箱设备建立连接。其中,所述连接可依据与所述音箱设备的接触、接近等触发建立。用户将移动终端放置到音箱设备上以后,音箱设备检测到接触时可通过所约定的无线通信方式实现与移动终端的连接。
步骤304,接收第一指令,依据第一指令运行所述音箱设备对应的应用程序。在音箱设备和移动终端连接后,音箱设备可生成第一指令,该第一指令用于指示所述移动终端与所述音箱设备连接成功,移动终端接收到第一指令后,依据所述第一指令确定与所述音箱设备对应的应用程序;然后判断移动终端内是否已运行与所述音箱设备对应的应用程序;若与所述音箱设备对应的应用程序未运行,则运行与所述音箱设备对应的应用程序;在所述音箱设备对应的应用程序运行成功后,可在与所述音箱设备对应的应用程序上显示连接成功的提示信息。此后,移动终端可作为该音箱设备的显示器进行信息的显示。Step 304: Receive a first instruction, and run an application program corresponding to the speaker device according to the first instruction. After the speaker device and the mobile terminal are connected, the speaker device can generate a first instruction, the first instruction is used to indicate that the mobile terminal and the speaker device are successfully connected, and after the mobile terminal receives the first instruction, according to the first instruction The instruction determines the application program corresponding to the speaker device; then judges whether the application program corresponding to the speaker device has been run in the mobile terminal; if the application program corresponding to the speaker device is not running, run the application program corresponding to the speaker device The corresponding application program; after the application program corresponding to the speaker device runs successfully, a prompt message indicating that the connection is successful can be displayed on the application program corresponding to the speaker device. Thereafter, the mobile terminal can be used as a display of the sound box device to display information.
步骤306,依据所述应用程序的显示信息,与所述音箱设备进行数据交互,以在所述音箱设备上输出所述应用程序上显示信息对应的音频数据。
移动终端中运行与音箱设备对应的应用程序后,音箱设备和应用程序可互连并进行数据交互,也可与网络侧的服务端连接。其中,音箱设备和应用程序可登录同一用户的账户,或者登录匹配的账户,从而对于一端的消息,另一端可以匹配响应,将音箱设备作为音频输入/输出端,提供音频的输入、输出,移动终端结合应用程序作为显示端,提供显示信息。After running the application program corresponding to the speaker device in the mobile terminal, the speaker device and the application program can be interconnected for data interaction, and can also be connected with the server on the network side. Among them, the speaker device and the application can log in to the same user's account, or log in to a matching account, so that for a message from one end, the other end can match the response, using the speaker device as an audio input/output terminal, providing audio input and output, mobile The terminal is combined with the application program as a display terminal to provide display information.
音箱设备和移动终端连接后可进行数据交互,对于应用程序上的显示信息,可确定对应要输出的音频数据,该音频数据可在音箱设备上输出。对于音箱设备上语音数据所识别得到的第二指令,也可在移动终端的应用程序上显示响应的显示信息。一个可选实施例中,接收第二指令,通过所述应用程序执行所述第二指令对应的操作,其中,所述第二指令依据所述音箱设备接收的语音数据确定。接收到音箱设备发送的第二指令后,可基于该第二指令执行相应的处理操作,如搜索查询、播放试听节目等,从而可确定出第二指令对应的显示信息和音频数据,或发送所述指令给服务端以执行第二指令对应的处理操作,得到对应的显示信息和音频数据。然后可在应用程序的界面中显示所述显示信息,并在音箱设备上输出相应的音频数据。其中,依据所述第二指令所确定的音频数据,可由服务端或应用程序反馈给音箱设备,并且该音频数据还对应有在应用程序中显示的显示信息,使得应用程序的显示内容与音箱设备上输出的音频彼此对应。After the speaker device and the mobile terminal are connected, data interaction can be performed. For the display information on the application program, the corresponding audio data to be output can be determined, and the audio data can be output on the speaker device. For the second instruction recognized by the voice data on the speaker device, the corresponding display information can also be displayed on the application program of the mobile terminal. In an optional embodiment, a second instruction is received, and an operation corresponding to the second instruction is executed by the application program, wherein the second instruction is determined according to the voice data received by the speaker device. After receiving the second instruction sent by the speaker device, it can perform corresponding processing operations based on the second instruction, such as search query, play audition programs, etc., so as to determine the display information and audio data corresponding to the second instruction, or send the The above-mentioned instruction is given to the server to execute the processing operation corresponding to the second instruction to obtain corresponding display information and audio data. The display information can then be displayed in the interface of the application program, and corresponding audio data can be output on the speaker device. The audio data determined according to the second instruction can be fed back to the speaker device by the server or the application program, and the audio data also corresponds to the display information displayed in the application program, so that the display content of the application program is consistent with the speaker device. The audio output above corresponds to each other.
本申请实施例中,音箱设备还提供了无线充电功能,从而在音箱设备和移动终端连接后,可接收所述音箱设备的信号,以基于音箱设备内置的无线充电线圈进行无线充电。In the embodiment of the present application, the speaker device also provides a wireless charging function, so that after the speaker device is connected to the mobile terminal, a signal from the speaker device can be received to perform wireless charging based on the built-in wireless charging coil of the speaker device.
移动终端和音箱设备的交互响应过程、无线充电过程与上述实施例类似,因此不在赘述。The interactive response process and the wireless charging process of the mobile terminal and the speaker device are similar to the above-mentioned embodiments, and therefore will not be described in detail.
在上述实施例的基础上,本申请实施例提供了一种数据处理方法,在移动终端和音箱设备接触互连后,可在服务端侧绑定该移动终端和音箱设备,从而彼此响应进行显示和音频的输入/输出。本示例中,音箱设备直接与服务端交互获取音频数据。On the basis of the above embodiments, the embodiments of the present application provide a data processing method. After the mobile terminal and the speaker device are in contact and interconnected, the mobile terminal and the speaker device can be bound on the server side, so as to display in response to each other. and audio input/output. In this example, the speaker device directly interacts with the server to obtain audio data.
参照图4,示出了本申请实施例的一种数据处理方法的交互示意图。Referring to FIG. 4 , an interactive schematic diagram of a data processing method according to an embodiment of the present application is shown.
步骤402,用户将移动终端放置到音箱设备上以后,音箱设备与移动终端通过所约定的无线通信方式实现连接。如检测到所述音箱设备与所述移动终端接触,建立与移动终端的连接。In step 402, after the user places the mobile terminal on the speaker device, the speaker device and the mobile terminal are connected through an agreed wireless communication manner. If it is detected that the sound box device is in contact with the mobile terminal, a connection with the mobile terminal is established.
步骤404,音箱设备发送第一指令给移动终端,所述第一指令用于指示所述移动终端与所述音箱设备连接成功。Step 404, the speaker device sends a first instruction to the mobile terminal, where the first instruction is used to indicate that the mobile terminal is successfully connected with the speaker device.
步骤406,移动终端依据该第一指令,运行与所述音箱设备对应的应用程序。Step 406, the mobile terminal runs an application program corresponding to the speaker device according to the first instruction.
移动终端和音箱设备可进行数据交互,从而移动终端的应用程序输出的显示信息与音箱设备输出的音频数据相对应。The mobile terminal and the speaker device can perform data interaction, so that the display information output by the application program of the mobile terminal corresponds to the audio data output by the speaker device.
步骤408A,播放与所述移动终端连接成功的音频提示信息。Step 408A: Play the audio prompt message that the connection with the mobile terminal is successful.
步骤408B,显示在与所述音箱设备对应的应用程序上显示连接成功的提示信息。Step 408B, displaying a prompt message that the connection is successful on the application program corresponding to the speaker device.
步骤410,用户说出需要的服务,音箱设备接收对应的语音数据,通过识别分析确定对应的第二指令,如查询指令、交互指令等。如查询北京天气,讲笑话、听音乐等。In step 410, the user speaks the required service, the speaker device receives the corresponding voice data, and determines the corresponding second instruction through identification and analysis, such as a query instruction, an interactive instruction, and the like. Such as checking the weather in Beijing, telling jokes, listening to music, etc.
步骤412,音箱设备发送该第二指令给服务端。Step 412, the speaker device sends the second instruction to the server.
步骤414,服务端依据该第二指令确定对应的响应信息,响应信息包括音频响应信息和显示响应信息,其中,步骤414A,服务端返回音频数据给音箱设备;步骤414B,服务端返回显示信息给终端设备。其中,服务端已记录音箱设备和移动终端的绑定关系,因此从而能够反馈对应的音频数据给音箱设备并且反馈对应的显示信息给移动终端。如天气的预报页面、笑话的文字内容、音乐的专辑封面给移动终端,天气的语音预报数据、笑话的语音数据、音乐的音频数据给音箱设备。Step 414, the server determines the corresponding response information according to the second instruction, and the response information includes audio response information and display response information. In step 414A, the server returns audio data to the speaker device; Step 414B, the server returns display information to the speaker device. Terminal Equipment. The server has recorded the binding relationship between the speaker device and the mobile terminal, so it can feed back corresponding audio data to the speaker device and feed back corresponding display information to the mobile terminal. For example, the weather forecast page, the text content of the joke, and the album cover of the music are sent to the mobile terminal, and the voice forecast data of the weather, the voice data of the joke, and the audio data of the music are sent to the speaker device.
步骤416A,在音箱设备中输出该音频数据,该音频数据与移动终端的应用程序中显示信息对应。Step 416A: Output the audio data in the speaker device, where the audio data corresponds to the information displayed in the application program of the mobile terminal.
步骤416B,在移动终端的应用程序中显示该显示信息,该显示信息与音箱设备中音频数据对应。Step 416B: Display the display information in the application program of the mobile terminal, where the display information corresponds to the audio data in the speaker device.
从而基于音箱设备、移动终端和服务端的交互,实现对所需指令的反馈,并且能够在音箱设备中输出音频数据的同时,在移动终端上显示对应的显示信息,实现显示和音频输出的同步响应。Therefore, based on the interaction between the speaker device, the mobile terminal and the server, the feedback of the required commands can be realized, and the corresponding display information can be displayed on the mobile terminal while the audio data is output in the speaker device, so as to realize the synchronous response of display and audio output. .
在上述实施例的基础上,本申请实施例提供了一种数据处理方法,在移动终端和音箱设备接触互连后,可在服务端侧绑定该移动终端和音箱设备,从而彼此响应进行显示和音频的输入/输出。本示例中,音箱设备可通过移动终端与服务端交互获取音频数据。On the basis of the above embodiments, the embodiments of the present application provide a data processing method. After the mobile terminal and the speaker device are in contact and interconnected, the mobile terminal and the speaker device can be bound on the server side, so as to display in response to each other. and audio input/output. In this example, the speaker device can acquire audio data by interacting with the server through the mobile terminal.
参照图5,示出了本申请实施例的另一种数据处理方法的交互示意图。Referring to FIG. 5 , an interactive schematic diagram of another data processing method according to an embodiment of the present application is shown.
步骤502,用户将移动终端放置到音箱设备上以后,音箱设备与移动终端通过所约定的无线通信方式实现连接。In step 502, after the user places the mobile terminal on the speaker device, the speaker device and the mobile terminal are connected through an agreed wireless communication manner.
步骤504,音箱设备发送第一指令给移动终端。Step 504, the speaker device sends a first instruction to the mobile terminal.
步骤506,移动终端依据该第一指令,运行与所述音箱设备对应的应用程序。Step 506, the mobile terminal runs an application program corresponding to the speaker device according to the first instruction.
移动终端和音箱设备可进行数据交互,从而移动终端的应用程序输出的显示信息与音箱设备输出的音频数据相对应。The mobile terminal and the speaker device can perform data interaction, so that the display information output by the application program of the mobile terminal corresponds to the audio data output by the speaker device.
步骤508A,播放与所述移动终端连接成功的音频提示信息。Step 508A: Play the audio prompt information that the connection with the mobile terminal is successful.
步骤508B,显示在与所述音箱设备对应的应用程序上显示连接成功的提示信息。Step 508B, displaying a prompt message indicating that the connection is successful on the application program corresponding to the speaker device.
步骤510,用户说出需要的服务,音箱设备接收对应的语音数据,通过识别分析确定对应的第二指令。Step 510, the user speaks the required service, the speaker device receives the corresponding voice data, and determines the corresponding second instruction through identification and analysis.
步骤512,音箱设备发送该第二指令给移动终端。Step 512, the speaker device sends the second instruction to the mobile terminal.
步骤514,移动终端的应用程序可接收该第二指令,然后转发给对应的服务端。Step 514, the application program of the mobile terminal can receive the second instruction, and then forward it to the corresponding server.
步骤516,服务端依据该第二指令确定对应的响应信息,响应信息包括音频响应信息和显示响应信息,从而能够反馈对应的音频数据给音箱设备并且反馈对应的显示信息给移动终端。如天气的预报页面、笑话的文字内容、音乐的专辑封面给移动终端,天气的语音预报数据、笑话的语音数据、音乐的音频数据给音箱设备。Step 516, the server determines corresponding response information according to the second instruction, the response information includes audio response information and display response information, so that the corresponding audio data can be fed back to the speaker device and corresponding display information can be fed back to the mobile terminal. For example, the weather forecast page, the text content of the joke, and the album cover of the music are sent to the mobile terminal, and the voice forecast data of the weather, the voice data of the joke, and the audio data of the music are sent to the speaker device.
步骤518,移动终端将音频数据发送给音箱设备。Step 518, the mobile terminal sends the audio data to the speaker device.
步骤520A,在音箱设备中输出该音频数据,该音频数据与移动终端的应用程序中显示信息对应。Step 520A: Output the audio data in the speaker device, where the audio data corresponds to the information displayed in the application program of the mobile terminal.
步骤520B,在移动终端的应用程序中显示该显示信息,该显示信息与音箱设备中音频数据对应。Step 520B: Display the display information in the application program of the mobile terminal, where the display information corresponds to the audio data in the speaker device.
从而基于音箱设备、移动终端和服务端的交互,实现对所需指令的反馈,并且能够在音箱设备中输出音频数据的同时,在移动终端上显示对应的显示信息,实现显示和音频输出的同步响应。Therefore, based on the interaction between the speaker device, the mobile terminal and the server, the feedback of the required commands can be realized, and the corresponding display information can be displayed on the mobile terminal while the audio data is output in the speaker device, so as to realize the synchronous response of display and audio output. .
在上述实施例的基础上,本申请实施例提供了一种数据处理方法,在移动终端和音箱设备接触互连后,该移动终端和音箱设备能够彼此响应进行显示和音频的输入/输出。On the basis of the above embodiments, the embodiments of the present application provide a data processing method. After the mobile terminal and the sound box device are in contact and interconnected, the mobile terminal and the sound box device can respond to each other for display and audio input/output.
参照图6,示出了本申请实施例的又一种数据处理方法的交互示意图。Referring to FIG. 6 , an interactive schematic diagram of still another data processing method according to an embodiment of the present application is shown.
步骤602,用户将移动终端放置到音箱设备上以后,音箱设备与移动终端通过所约定的无线通信方式实现连接。Step 602, after the user places the mobile terminal on the speaker device, the speaker device and the mobile terminal are connected through the agreed wireless communication method.
步骤604,音箱设备发送第一指令给移动终端。Step 604, the speaker device sends a first instruction to the mobile terminal.
步骤606,移动终端依据该第一指令,运行与所述音箱设备对应的应用程序。Step 606, the mobile terminal runs an application program corresponding to the speaker device according to the first instruction.
移动终端和音箱设备可进行数据交互,从而移动终端的应用程序输出的显示信息与音箱设备输出的音频数据相对应。The mobile terminal and the speaker device can perform data interaction, so that the display information output by the application program of the mobile terminal corresponds to the audio data output by the speaker device.
步骤608A,播放与所述移动终端连接成功的音频提示信息。Step 608A: Play the audio prompt message that the connection with the mobile terminal is successful.
步骤608B,显示在与所述音箱设备对应的应用程序上显示连接成功的提示信息。Step 608B, displaying a prompt message indicating that the connection is successful on the application program corresponding to the speaker device.
步骤610,用户说出需要的服务,音箱设备接收对应的语音数据,通过识别分析确定对应的第二指令。Step 610, the user speaks the required service, the speaker device receives the corresponding voice data, and determines the corresponding second instruction through identification and analysis.
步骤612,音箱设备发送该第二指令给移动终端。Step 612, the speaker device sends the second instruction to the mobile terminal.
步骤614,移动终端的应用程序基于该第二指令,可确定对应的响应信息,响应信息包括音频数据和显示信息。Step 614: Based on the second instruction, the application program of the mobile terminal may determine corresponding response information, where the response information includes audio data and display information.
步骤616,移动终端将音频数据发送给音箱设备。Step 616, the mobile terminal sends the audio data to the speaker device.
步骤618A,在音箱设备中输出该音频数据,,该音频数据与移动终端的应用程序中显示信息对应。Step 618A: Output the audio data in the speaker device, where the audio data corresponds to the information displayed in the application program of the mobile terminal.
步骤618B,在移动终端的应用程序中显示该显示信息,该显示信息与音箱设备中音频数据对应。Step 618B: Display the display information in the application program of the mobile terminal, where the display information corresponds to the audio data in the speaker device.
从而基于音箱设备、移动终端的交互,实现对所需指令的反馈,可基于移动终端给用户提供所需的服务,如时间的提示、日程设备等,并且能够在音箱设备中输出音频数据的同时,在移动终端上显示对应的显示信息,实现显示和音频输出的同步响应。Therefore, based on the interaction between the speaker device and the mobile terminal, the feedback of the required instructions can be realized, and the required services can be provided to the user based on the mobile terminal, such as time prompts, schedule equipment, etc., and the audio data can be output in the speaker device at the same time. , display the corresponding display information on the mobile terminal, and realize the synchronous response of display and audio output.
在上述实施例的基础上,本申请实施例提供了一种无线充电方法,在移动终端和音箱设备接触互连后,该移动终端和音箱设备能够彼此响应进行显示和音频的输入/输出。On the basis of the above embodiments, the embodiments of the present application provide a wireless charging method. After the mobile terminal and the speaker device are in contact and interconnected, the mobile terminal and the speaker device can respond to each other for display and audio input/output.
参照图7,示出了本申请实施例的一种无线充电方法的交互示意图。Referring to FIG. 7 , an interactive schematic diagram of a wireless charging method according to an embodiment of the present application is shown.
步骤702,用户将移动终端放置到音箱设备上以后,音箱设备与移动终端通过所约定的无线通信方式实现连接。之后音箱设备发送第一指令给移动终端,移动终端依据该第一指令,运行与所述音箱设备对应的应用程序。In step 702, after the user places the mobile terminal on the speaker device, the speaker device and the mobile terminal are connected through an agreed wireless communication manner. Afterwards, the speaker device sends a first instruction to the mobile terminal, and the mobile terminal runs an application program corresponding to the speaker device according to the first instruction.
步骤704,用户要给移动终端充电时,可直接说出给XX充电等内容,音箱设备接收对应的语音数据,通过识别分析确定对应为充电指令。Step 704, when the user wants to charge the mobile terminal, he can directly say the contents such as charging XX, the speaker device receives the corresponding voice data, and determines the corresponding charging instruction through identification and analysis.
步骤706,音箱设备基于该充电指令,可启动无线充电功能,从而通过内置的无线充电线圈为移动终端充电。Step 706: Based on the charging instruction, the speaker device can activate the wireless charging function, so as to charge the mobile terminal through the built-in wireless charging coil.
从而能够便捷的给移动终端充电,移动终端为音箱设备响应显示信息的同时还可显示充电的电量信息。Therefore, the mobile terminal can be conveniently charged, and the mobile terminal can also display the charging power information while responding to the display information for the speaker device.
在上述实施例的基础上,本申请实施例还可应用于各种不具备屏幕的设备和具备屏幕的设备之间的连接交互。其中,第一智能设备可为不具备屏幕的设备,例如第一智能设备为音箱设备,录音笔,智能手环等不具有屏幕的可穿戴设备等;第二智能设备可为具备屏幕的设备,如所述第二智能设备为手机、平板电脑等移动设备,智能手表等具有屏幕的可穿戴设备等。本申请实施例的智能设备包括能够提供语音识别、交互、上网等一个或多个功能的设备。On the basis of the foregoing embodiments, the embodiments of the present application can also be applied to connection interactions between various devices without screens and devices with screens. Wherein, the first smart device can be a device without a screen, for example, the first smart device is a speaker device, a voice recorder, a smart bracelet and other wearable devices without a screen, etc.; the second smart device can be a device with a screen, For example, the second smart device is a mobile device such as a mobile phone and a tablet computer, a wearable device with a screen such as a smart watch, and the like. The smart device in the embodiment of the present application includes a device capable of providing one or more functions such as speech recognition, interaction, and Internet access.
参照图8,示出了本申请实施例的再一种数据处理方法的交互示意图。Referring to FIG. 8 , an interactive schematic diagram of still another data processing method according to an embodiment of the present application is shown.
步骤802,建立与第二智能设备的连接,所述第二智能设备具备屏幕。Step 802: Establish a connection with a second smart device, where the second smart device has a screen.
第一智能设备中可具有压力传感器、红外传感器等,从而可检测到第一智能设备和第二智能设备的接触、接近等连接条件得到满足,然后第一智能设备与第二智能设备建立连接。其中,两个智能设备的连接可采用多种无线技术实现无线方式连接,例如通过蓝牙技术,NFC技术、wifi技术等。The first smart device may have a pressure sensor, an infrared sensor, etc., so that it can be detected that connection conditions such as contact and proximity between the first smart device and the second smart device are satisfied, and then the first smart device establishes a connection with the second smart device. Among them, the connection of the two smart devices can be realized by using a variety of wireless technologies, such as Bluetooth technology, NFC technology, wifi technology, and the like.
在一些可选实施例中,连接成功后,第一智能设备还可发送第一指令给第二智能设备,以通知连接成功。第二智能设备接收到第一指令后,可基于该第一指令确定第一智能设备对应的应用程序,如该第一指令中包括应用程序的应用标识,又如该第一指令中包括第一智能设备的设备标识,连接成功标识等标识信息,然后第二智能设备可依据该标识信息查询匹配的应用程序的应用标识等,在确定出应用程序后,可以判断该应用程序是否已运行,若第二智能设备上未运行该应用程序,则可运行该应用程序。In some optional embodiments, after the connection is successful, the first smart device may also send a first instruction to the second smart device to notify that the connection is successful. After receiving the first instruction, the second smart device can determine the application program corresponding to the first smart device based on the first instruction. For example, the first instruction includes the application identifier of the application program, or the first instruction includes the first Identification information such as the device identification of the smart device, the successful connection identification, etc., and then the second smart device can query the application identification of the matching application according to the identification information, etc. After determining the application, it can determine whether the application has been running. If the application is not running on the second smart device, the application can be run.
步骤804,所述第一智能设备输出音频数据。
步骤806,通过所述第二智能设备的屏幕,输出与所述音频数据对应的显示信息。Step 806: Output display information corresponding to the audio data through the screen of the second smart device.
在第一智能设备和第二智能设备的连接成功建立后,第一智能设备可输出音频数据,相应的,通过所述第二智能设备的屏幕,可同步输出与所述音频数据对应的显示信息。After the connection between the first smart device and the second smart device is successfully established, the first smart device can output audio data, and correspondingly, through the screen of the second smart device, the display information corresponding to the audio data can be output synchronously .
在一个可选实施例中,第一智能设备和第二智能设备的连接成功,且第二智能设备中与第一智能设备对应的应用程序运行后,第一智能设备可输出连接成功的语音提示信息,并且,第二智能设备可在与所述第一智能设备对应的应用程序上显示连接成功的提示信息,通知用户该应用程序与第一智能设备已连接、可执行交互。从而在第一智能设备和第二智能设备上均可输出连接成功的提示信息,便于用户执行后续的操作。In an optional embodiment, the connection between the first smart device and the second smart device is successful, and after the application program corresponding to the first smart device in the second smart device runs, the first smart device can output a voice prompt indicating that the connection is successful information, and the second smart device may display a prompt message of successful connection on the application program corresponding to the first smart device, notifying the user that the application program and the first smart device are connected and can perform interaction. Therefore, prompt information of successful connection can be output on both the first smart device and the second smart device, which is convenient for the user to perform subsequent operations.
在另外一些可选实施例中,第一智能设备可接收语音数据,通过对语音数据的识别处理,可确定对应的第二指令,然后可发送第二指令以确定所述第二指令对应的语音数据和显示信息,从而在第一智能设备可输出音频数据,相应的,通过所述第二智能设备的屏幕,可同步输出与所述音频数据对应的显示信息。在另外的一些可选实施例中,通过第二智能设备的屏幕输出显示信息的同时,也可在第一智能设备同步输出与所述显示信息对应的音频数据。In some other optional embodiments, the first smart device may receive voice data, determine the corresponding second instruction by recognizing the voice data, and then may send the second instruction to determine the voice corresponding to the second instruction data and display information, so that audio data can be output on the first smart device, and correspondingly, display information corresponding to the audio data can be output synchronously through the screen of the second smart device. In some other optional embodiments, while the display information is output through the screen of the second smart device, audio data corresponding to the display information may also be output synchronously on the first smart device.
本申请实施例中,第一智能设备和第二智能设备也可与网络侧的服务端连接。其中,第一智能设备和第二智能设备可登录同一用户的账户,或者登录匹配的账户,第一智能设备和第二智能设备可进行数据交互,对于一端的消息,另一端可以匹配响应,从而第一智能设备作为音频输入/输出端,提供音频的输入、输出,第二智能设备结合应用程序作为显示端,提供显示信息。In this embodiment of the present application, the first smart device and the second smart device may also be connected to the server on the network side. The first smart device and the second smart device can log in to the account of the same user, or log in to a matching account, and the first smart device and the second smart device can perform data interaction. The first smart device serves as an audio input/output end, providing audio input and output, and the second smart device, combined with an application program, serves as a display end, providing display information.
本申请实施例中,第一智能设备可第二智能设备可进行数据交互,第二智能设备的显示信息和第一智能设备的音频数据彼此响应,从而在第一智能设备上输出所述第二智能设备上显示信息对应的音频数据,以及在应用程度上显示音频数据对应的显示信息。例如第一智能设备输出天气相关的音频数据,第二智能设备可显示对应天气的预报页面;又如第二智能设备可基于第一智能设备输出的音频数据确定对应的表情进行显示,给用户提供聊天互动等。In this embodiment of the present application, the first smart device and the second smart device can perform data interaction, and the display information of the second smart device and the audio data of the first smart device respond to each other, so that the second smart device is output on the first smart device. The audio data corresponding to the information is displayed on the smart device, and the display information corresponding to the audio data is displayed at the application level. For example, the first smart device outputs weather-related audio data, and the second smart device can display a forecast page corresponding to the weather; another example, the second smart device can determine the corresponding expression based on the audio data output by the first smart device and display it, providing the user with Chat interaction, etc.
用户可通过说话指示所需的服务,从而第一智能设备和第二智能设备可分别输出相应的响应消息,给用户提供所需的服务。因此在本申请一个可选实施例中,还可接收语音数据,依据所述语音数据确定对应的第二指令;将所述第二指令发送给所述第二智能设备,以使所述第二智能设备执行所述第二指令对应的操作。The user can indicate the desired service by speaking, so that the first smart device and the second smart device can output corresponding response messages respectively to provide the user with the desired service. Therefore, in an optional embodiment of the present application, voice data may also be received, and a corresponding second instruction may be determined according to the voice data; the second instruction may be sent to the second smart device, so that the second instruction The smart device executes the operation corresponding to the second instruction.
一个示例中,第一智能设备可接收语音数据,然后可由第一智能设备对语音数据进行识别处理,对识别处理的识别结果进行分析,确定所需服务对应的第二指令,然后可将第二指令发送给服务端或第二智能设备处理。在另外一些示例中,第一智能设备可发送语音数据给第二智能设备,然后第二智能设备对接收的语音数据进行识别处理,依据识别结果进行分析,确定所需服务对应的第二指令,然后可将第二指令发送给服务端进行处理。服务端或第二智能设备基于该第二指令可执行相应的处理,如搜索信息、确定输出信息等,从而能够确定出在第二智能设备上输出的显示信息,以及在第一智能设备对应输出的音频数据,其中,该显示信息和音频数据对应。在另外的一些示例中,第一智能设备将第二指令传输给第二智能设备后,第二智能设备也可确定第二指令对应的显示信息以及音频数据,从而基于第二智能设备输出显示信息,并反馈音频数据给第一智能设备进行输出。In one example, the first smart device can receive the voice data, then the first smart device can perform recognition processing on the voice data, analyze the recognition result of the recognition processing, determine the second instruction corresponding to the required service, and then The instruction is sent to the server or the second smart device for processing. In some other examples, the first smart device can send voice data to the second smart device, and then the second smart device performs recognition processing on the received voice data, analyzes the recognition result, and determines the second instruction corresponding to the required service, The second instruction can then be sent to the server for processing. The server or the second smart device can perform corresponding processing based on the second instruction, such as searching for information, determining output information, etc., so as to determine the display information output on the second smart device, and the corresponding output on the first smart device. audio data, wherein the display information corresponds to the audio data. In some other examples, after the first smart device transmits the second command to the second smart device, the second smart device may also determine the display information and audio data corresponding to the second command, so as to output the display information based on the second smart device , and feed back audio data to the first smart device for output.
本申请实施例中,所述第二指令包括以下至少一种:充电指令、查询指令、交互指令。充电指令指的是用于指示充电的指令;查询指令指的是用于指示查询的指令;所述交互指令指的是用于指示执行交互的指令。In the embodiment of the present application, the second instruction includes at least one of the following: a charging instruction, a query instruction, and an interaction instruction. The charging instruction refers to an instruction for instructing charging; the query instruction refers to an instruction for instructing inquiry; and the interaction instruction refers to an instruction for instructing to perform interaction.
基于查询指令可为用户提供查询服务,其中查询包括对网络中各种服务信息的查询,如音乐、相声、脱口秀、故事、小说、评述、戏曲等娱乐内容的查询服务,时事新闻、财经资讯等新闻内容的查询服务,天气、时间、火车、航班等各项查询服务。上述查询服务的查询指令可基于第一智能设备对接收的语音数据的识别确定,如可基于唤醒词+查询内容的方式分析得到,唤醒词可依据需求设置,如为“查”“查询”,也可为音箱名称或第二智能设备的名称等,查询内容为具体需要查询的内容。该查询指令可由第一智能设备直接发送给服务端或第二智能设备,也可在第二智能设备接收并确定自身无法处理后转发给服务端,在服务端端该第一智能设备和第二智能设备可基于账户进行绑定,从而对于所查询指令对应的响应消息,可同步反馈给第一智能设备和第二智能设备,或者服务端反馈给第二智能设备,再由第二智能设备反馈给第一智能设备,本申请实施例对此不做限制。其中,对于所反馈查询的响应消息,其中音频部分可由第一智能设备解码输出,而其他部分可在终端设备的第二智能设备界面中同步显示输出,如显示故事的界面,显示音乐的专辑封面或音乐录影带(Music Video,MV),时事新闻、财经资讯等新闻内容的文字部分等,具体可依据需求和实际业务确定。Based on the query instructions, it can provide users with query services, including query services for various service information in the network, such as music, cross talk, talk shows, stories, novels, reviews, operas and other entertainment content query services, current affairs news, financial information and other news content query services, weather, time, trains, flights and other query services. The query command of the above query service can be determined based on the recognition of the received voice data by the first intelligent device, such as can be obtained based on the method of wake-up word + query content, and the wake-up word can be set according to requirements, such as "check" and "query", It can also be the name of the speaker or the name of the second smart device, etc. The query content is the specific content to be queried. The query instruction can be directly sent by the first smart device to the server or the second smart device, or it can be forwarded to the server after the second smart device receives it and determines that it cannot be processed by itself. On the server side, the first smart device and the second smart device The smart device can be bound based on the account, so that the response message corresponding to the queried instruction can be fed back to the first smart device and the second smart device synchronously, or the server can feed back to the second smart device, and then the second smart device can feedback For the first smart device, this embodiment of the present application does not limit this. Among them, for the response message of the feedback query, the audio part can be decoded and output by the first smart device, and the other part can be displayed and output synchronously in the second smart device interface of the terminal device, such as the interface for displaying stories, the album cover for displaying music Or music video (Music Video, MV), the text part of news content such as current affairs news, financial information, etc., which can be determined according to needs and actual business.
对于交互指令可由第一智能设备发送给服务端,或者第一智能设备发送给第二智能设备,第二智能设备自行处理或发送给服务端处理,得到相应的交互响应消息。例如一种交互方式为聊天交互,用户可以随意的说话与第一智能设备进行交互,第一智能设备基于语音处理确定相应的语义信息,并寻找该语义信息对应的答复内容,然后返回给第一智能设备进行语音输出。其中匹配该聊天的答复内容,可在第二智能设备的界面中显示相应的显示信息,如显示信息包括表情信息,表情信息指的是表达情感的显示信息,例如笑脸、哭脸、生气的表情等,使得用户得到对应的情感反馈,仿佛在与人聊天。在另外一些示例中,交互指令也可基于第二智能设备进行对应功能的交互,例如拨打电话、读写短信、查询时间、设置日程等,便于用户使用。The interaction instruction can be sent by the first smart device to the server, or the first smart device can be sent to the second smart device, and the second smart device can process it by itself or send it to the server for processing to obtain a corresponding interaction response message. For example, an interaction method is chat interaction. The user can speak at will to interact with the first smart device. The first smart device determines the corresponding semantic information based on voice processing, searches for the reply content corresponding to the semantic information, and then returns to the first smart device. Smart device for voice output. The corresponding display information can be displayed on the interface of the second smart device if it matches the reply content of the chat. For example, the display information includes expression information, and the expression information refers to the display information expressing emotions, such as smiling faces, crying faces, and angry expressions. etc., so that users get corresponding emotional feedback, as if they are chatting with people. In some other examples, the interaction instruction may also interact with corresponding functions based on the second smart device, such as making calls, reading and writing short messages, querying time, setting schedules, etc., which is convenient for users to use.
本申请实施例中,为了便于用户的使用,还可在第一智能设备中内置无线充电线圈,使得该第一智能设备还具有无线充电功能,通过该内置的无线充电线圈,为所述第二智能设备充电。一个示例中,第一智能设备可在与第二智能设备接触并连接成功后,自动为第二智能设备充电,另一个示例中,用户可说出给手机充电等指示,从而第一智能设备可基于语音识别分析得到充电指令,然后可启动第一智能设备的充电功能,为放置在其上的移动设备充电。其中,无线充电可基于电磁感应式,通过磁场和电能转换的方式实现不需要数据线连接的充电。从而第二智能设备和第一智能设备相连不但能够彼此响应交互,还能够无线充电。In the embodiment of the present application, in order to facilitate the use of the user, a wireless charging coil can also be built in the first smart device, so that the first smart device also has a wireless charging function, and the built-in wireless charging coil is used for the second smart device. Smart device charging. In one example, the first smart device can automatically charge the second smart device after being in contact with the second smart device and successfully connected. In another example, the user can speak instructions such as charging the mobile phone, so that the first smart device can The charging instruction is obtained based on the voice recognition analysis, and then the charging function of the first smart device can be activated to charge the mobile device placed thereon. Among them, wireless charging can be based on electromagnetic induction, and can realize charging that does not require data line connection by means of magnetic field and electric energy conversion. Therefore, when the second smart device and the first smart device are connected, they can not only respond and interact with each other, but also be able to charge wirelessly.
需要说明的是,对于方法实施例,为了简单描述,故将其都表述为一系列的动作组合,但是本领域技术人员应该知悉,本申请实施例并不受所描述的动作顺序的限制,因为依据本申请实施例,某些步骤可以采用其他顺序或者同时进行。其次,本领域技术人员也应该知悉,说明书中所描述的实施例均属于优选实施例,所涉及的动作并不一定是本申请实施例所必须的。It should be noted that, for the sake of simple description, the method embodiments are expressed as a series of action combinations, but those skilled in the art should know that the embodiments of the present application are not limited by the described action sequence, because According to the embodiments of the present application, certain steps may be performed in other sequences or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present application.
在上述实施例的基础上,本实施例还提供了一种数据处理装置,应用于音箱设备中。On the basis of the above-mentioned embodiment, this embodiment also provides a data processing apparatus, which is applied to a speaker device.
参照图9,示出了本申请的一种数据处理装置实施例的结构框图,具体可以包括如下模块:Referring to FIG. 9 , a structural block diagram of an embodiment of a data processing apparatus according to the present application is shown, which may specifically include the following modules:
连接模块902,用于建立与所述移动终端的连接。A connection module 902, configured to establish a connection with the mobile terminal.
指令发送模块904,用于发送第一指令给所述移动终端,所述移动终端上具有与所述音箱设备对应的应用程序。The instruction sending module 904 is configured to send a first instruction to the mobile terminal, and the mobile terminal has an application program corresponding to the speaker device.
交互输出模块906,用于通过与所述移动终端的数据交互,在所述音箱设备上输出所述应用程序上显示信息对应的音频数据。The interaction output module 906 is configured to output audio data corresponding to the information displayed on the application program on the speaker device through data interaction with the mobile terminal.
综上,音箱设备可以建立与该移动终端的连接,使得音箱设备和移动终端能够便捷的连接,然后音箱设备可发送第一指令给移动终端,可在移动终端中运行与该音箱设备对应的应用程序,使得移动终端能够作为音箱设备的显示器,通过与所述移动终端的数据交互,应用程序的显示信息和音箱设备输出的音频数据彼此响应,音箱设备在为用户提供优质音效的同时,还能够通过连接的移动终端为用户显示所需的信息。In summary, the speaker device can establish a connection with the mobile terminal, so that the speaker device and the mobile terminal can be conveniently connected, and then the speaker device can send the first command to the mobile terminal, and the application corresponding to the speaker device can be run in the mobile terminal. The program enables the mobile terminal to act as a display of the speaker device, and through data interaction with the mobile terminal, the display information of the application and the audio data output by the speaker device respond to each other, and the speaker device can provide users with high-quality sound effects. The required information is displayed to the user via the connected mobile terminal.
参照图10,示出了本申请的一种数据处理装置可选实施例的结构框图,具体可以包括如下模块:Referring to FIG. 10, a structural block diagram of an optional embodiment of a data processing apparatus of the present application is shown, which may specifically include the following modules:
连接模块902,用于建立与所述移动终端的连接。A connection module 902, configured to establish a connection with the mobile terminal.
指令发送模块904,用于发送第一指令给所述移动终端,所述移动终端上具有与所述音箱设备对应的应用程序。所述第一指令用于指示所述移动终端与所述音箱设备连接成功。The instruction sending module 904 is configured to send a first instruction to the mobile terminal, and the mobile terminal has an application program corresponding to the speaker device. The first instruction is used to indicate that the mobile terminal is successfully connected with the sound box device.
交互输出模块906,用于通过与所述移动终端的数据交互,在所述音箱设备上输出所述应用程序上显示信息对应的音频数据。The interaction output module 906 is configured to output audio data corresponding to the information displayed on the application program on the speaker device through data interaction with the mobile terminal.
无线充电模块908,用于通过内置的无线充电线圈,为所述移动终端充电。The wireless charging module 908 is used for charging the mobile terminal through the built-in wireless charging coil.
语音指示模块910,用于接收语音数据,依据所述语音数据确定对应的第二指令。则所述指令发送模块904,用于将所述第二指令发送给所述移动终端,以使所述应用程序执行所述第二指令对应的操作。The voice instruction module 910 is configured to receive voice data, and determine a corresponding second instruction according to the voice data. Then, the instruction sending module 904 is configured to send the second instruction to the mobile terminal, so that the application program executes the operation corresponding to the second instruction.
其中,所述第二指令包括以下至少一种:充电指令、查询指令、交互指令。所述显示信息包括表情信息。Wherein, the second instruction includes at least one of the following: a charging instruction, a query instruction, and an interaction instruction. The display information includes facial expression information.
所述连接模块902,用于检测到所述音箱设备与所述移动终端接触,建立与移动终端的连接。The connection module 902 is configured to detect that the sound box device is in contact with the mobile terminal, and establish a connection with the mobile terminal.
所述交互输出模块906,还用于播放与所述移动终端连接成功的音频提示信息。The interactive output module 906 is further configured to play audio prompt information about the successful connection with the mobile terminal.
在上述实施例的基础上,本实施例还提供了一种数据处理装置,应用于手机、平板电脑等移动终端中。On the basis of the foregoing embodiment, the present embodiment further provides a data processing apparatus, which is applied to mobile terminals such as mobile phones and tablet computers.
参照图11,示出了本申请的另一种数据处理装置实施例的结构框图,具体可以包括如下模块:Referring to FIG. 11 , a structural block diagram of another data processing apparatus embodiment of the present application is shown, which may specifically include the following modules:
连接建立模块1102,用于与音箱设备建立连接。The connection establishment module 1102 is used to establish a connection with the speaker device.
指令接收模块1104,用于接收所述音箱设备的第一指令,依据所述第一指令运行与所述音箱设备对应的应用程序。The instruction receiving module 1104 is configured to receive a first instruction of the speaker device, and run an application program corresponding to the speaker device according to the first instruction.
交互显示模块1106,用于依据所述应用程序的显示信息,与所述音箱设备进行数据交互,以在所述音箱设备上输出所述应用程序上显示信息对应的音频数据。The interactive display module 1106 is configured to perform data interaction with the speaker device according to the display information of the application program, so as to output audio data corresponding to the information displayed on the application program on the speaker device.
综上,音箱设备可以建立与该移动终端的连接,使得音箱设备和移动终端能够便捷的连接,然后移动终端可接收音箱设备的第一指令,可在移动终端中启动与该音箱设备对应的应用程序,使得移动终端能够作为音箱设备的显示器,通过音箱设备和移动终端的交互数据,应用程序的显示信息和音箱设备输出的音频数据彼此响应,音箱设备在为用户提供优质音效的同时,还能够通过连接的移动终端为用户显示所需的信息。To sum up, the speaker device can establish a connection with the mobile terminal, so that the speaker device and the mobile terminal can be conveniently connected, and then the mobile terminal can receive the first command of the speaker device, and can start the application corresponding to the speaker device in the mobile terminal. The program enables the mobile terminal to be used as the display of the speaker device. Through the interactive data between the speaker device and the mobile terminal, the display information of the application program and the audio data output by the speaker device respond to each other. The speaker device can provide users with high-quality sound effects. The required information is displayed to the user via the connected mobile terminal.
参照图12,示出了本申请的另一种数据处理装置可选实施例的结构框图,具体可以包括如下模块:Referring to FIG. 12 , a structural block diagram of another optional embodiment of a data processing apparatus of the present application is shown, which may specifically include the following modules:
连接建立模块1102,用于与音箱设备建立连接。The connection establishment module 1102 is used to establish a connection with the speaker device.
指令接收模块1104,用于接收所述音箱设备的第一指令,依据所述第一指令运行与所述音箱设备对应的应用程序。所述第一指令用于指示所述移动终端与所述音箱设备连接成功。The instruction receiving module 1104 is configured to receive a first instruction of the speaker device, and run an application program corresponding to the speaker device according to the first instruction. The first instruction is used to indicate that the mobile terminal is successfully connected with the sound box device.
响应显示模块1106,用于依据所述应用程序的显示信息,与所述音箱设备进行数据交互,以在所述音箱设备上输出所述应用程序上显示信息对应的音频数据。The response display module 1106 is configured to perform data interaction with the speaker device according to the display information of the application program, so as to output audio data corresponding to the information displayed on the application program on the speaker device.
充电模块1108,用于接收所述音箱设备的信号,以进行无线充电,其中,所述音箱设备内置有无线充电线圈。The charging module 1108 is used for receiving the signal of the speaker device for wireless charging, wherein the speaker device has a built-in wireless charging coil.
指令接收模块1104,还用于接收第二指令,通过所述应用程序执行所述第二指令对应的操作,其中,所述第二指令依据所述音箱设备接收的语音数据确定。The instruction receiving module 1104 is further configured to receive a second instruction, and execute an operation corresponding to the second instruction through the application program, wherein the second instruction is determined according to the voice data received by the speaker device.
所述第二指令包括以下至少一种:充电指令、查询指令、交互指令。所述显示信息包括表情信息。The second instruction includes at least one of the following: a charging instruction, a query instruction, and an interaction instruction. The display information includes facial expression information.
所述连接建立模块1102,用于检测到所述移动终端与所述音箱设备接触,建立与所述音箱设备的连接。The connection establishing module 1102 is configured to detect that the mobile terminal is in contact with the sound box device, and establish a connection with the sound box device.
所述指令接收模块1104,用于依据所述第一指令确定与所述音箱设备对应的应用程序;若与所述音箱设备对应的应用程序未运行,则运行与所述音箱设备对应的应用程序;在与所述音箱设备对应的应用程序上显示连接成功的提示信息。The instruction receiving module 1104 is used to determine the application program corresponding to the speaker device according to the first instruction; if the application program corresponding to the speaker device is not running, run the application program corresponding to the speaker device ; Display the prompt information of successful connection on the application program corresponding to the speaker device.
所述显示信息包括表情信息,所述表情信息与所述音箱设备的音频数据对应。The display information includes facial expression information, and the facial expression information corresponds to the audio data of the speaker device.
本申请实施例中在移动终端和音箱设备接触互连后,可在服务端侧绑定该移动终端和音箱设备,从而彼此响应进行显示和音频的输入/输出。其中,音箱设备直接与服务端交互获取音频数据,或者,音箱设备可通过移动终端与服务端交互获取音频数据。In the embodiment of the present application, after the mobile terminal and the sound box device are in contact and interconnected, the mobile terminal and the sound box device can be bound on the server side, so as to perform display and audio input/output in response to each other. The speaker device directly interacts with the server to obtain audio data, or the speaker device can interact with the server to obtain audio data through a mobile terminal.
基于音箱设备、移动终端和服务端的交互,实现对所需指令的反馈,并且能够在音箱设备中输出音频数据的同时,在移动终端上显示对应的显示信息,实现显示和音频输出的同步响应。也可基于移动终端给用户提供所需的服务,如时间的提示、日程设备等,并且能够在音箱设备中输出音频数据的同时,在移动终端上显示对应的显示信息,实现显示和音频输出的同步响应。Based on the interaction between the speaker device, the mobile terminal and the server, the feedback of the required commands can be realized, and the corresponding display information can be displayed on the mobile terminal while outputting the audio data in the speaker device, so as to realize the synchronous response of display and audio output. It can also provide users with required services based on the mobile terminal, such as time prompts, schedule equipment, etc., and can output audio data in the speaker device while displaying the corresponding display information on the mobile terminal to realize the display and audio output. Synchronous response.
还能够便捷的给移动终端充电,移动终端为音箱设备响应显示信息的同时还可显示充电的电量信息。The mobile terminal can also be conveniently charged, and the mobile terminal can also display the charging power information while responding to the display information for the speaker device.
在上述实施例的基础上,本申请实施例还提供了一种本实施例还提供了一种数据处理装置,应用于不具备屏幕的第一智能设备中,如音箱设备、智能手环等。On the basis of the above embodiment, the embodiment of the present application further provides a data processing apparatus, which is applied to a first smart device without a screen, such as a speaker device, a smart bracelet, and the like.
参照图13,示出了本申请的又一种数据处理装置实施例的结构框图,具体可以包括如下模块:Referring to FIG. 13 , a structural block diagram of another data processing apparatus embodiment of the present application is shown, which may specifically include the following modules:
设备连接模块1302,用于建立与第二智能设备的连接,所述第二智能设备具备屏幕。A device connection module 1302, configured to establish a connection with a second smart device, where the second smart device has a screen.
输出模块1304,用于所述第一智能设备输出音频数据;通过所述第二智能设备的屏幕,输出与所述音频数据对应的显示信息。The output module 1304 is used for the first smart device to output audio data; and output the display information corresponding to the audio data through the screen of the second smart device.
一个可选实施例中,所述第一智能设备还内置有无线充电线圈,则所述装置还包括:线圈充电模块1306,,用于通过内置的无线充电线圈,为所述第二智能设备充电。In an optional embodiment, if the first smart device also has a built-in wireless charging coil, the apparatus further includes: a coil charging module 1306 for charging the second smart device through the built-in wireless charging coil .
输出模块1304,还用于接收语音数据,依据所述语音数据确定对应的第二指令将所述第二指令发送给所述第二智能设备,以使所述第二智能设备执行所述第二指令对应的操作。其中,第二智能设备可运行与第一智能设备对应的应用程序,基于该应用程序与第一智能设备进行交互。The output module 1304 is further configured to receive voice data, determine a corresponding second command according to the voice data, and send the second command to the second smart device, so that the second smart device executes the second command. The operation corresponding to the command. The second smart device can run an application program corresponding to the first smart device, and interact with the first smart device based on the application program.
其中,所述第二指令包括以下至少一种:充电指令、查询指令、交互指令。所述显示信息包括表情信息。Wherein, the second instruction includes at least one of the following: a charging instruction, a query instruction, and an interaction instruction. The display information includes facial expression information.
所述设备连接模块1302,用于检测到所述第一智能设备与所述第二智能设备接触,建立与移动终端的连接。The device connection module 1302 is configured to detect that the first smart device is in contact with the second smart device, and establish a connection with the mobile terminal.
所述输出模块1304,还用于播放与所述第二智能设备连接成功的音频提示信息。相应的,所述第二智能设备也可显示连接成功的提示信息。The output module 1304 is further configured to play audio prompt information about the successful connection with the second smart device. Correspondingly, the second smart device may also display prompt information that the connection is successful.
基于第一智能设备和第二智能设备的互连,可第一智能设备作为音频输入/输出端,提供音频的输入、输出,第二智能设备结合应用程序作为显示端,提供显示信息,给用户的使用提供便利。Based on the interconnection of the first smart device and the second smart device, the first smart device can be used as an audio input/output terminal to provide audio input and output, and the second smart device can be used as a display terminal in combination with an application program to provide display information to the user. convenience of use.
本申请实施例还提供了一种非易失性可读存储介质,该存储介质中存储有一个或多个模块(programs),该一个或多个模块被应用在设备时,可以使得该设备执行本申请实施例中各方法步骤的指令(instructions)。Embodiments of the present application further provide a non-volatile readable storage medium, where one or more modules (programs) are stored in the storage medium, and when the one or more modules are applied to a device, the device can be executed by the device. Instructions for each method step in the embodiments of the present application.
本申请实施例提供了一个或多个机器可读介质,其上存储有指令,当由一个或多个处理器执行时,使得电子设备执行如上述实施例中一个或多个所述的方法。本申请实施例中,所述电子设备包括终端设备、服务端(集群)等各类型的设备。The embodiments of the present application provide one or more machine-readable media on which instructions are stored, and when executed by one or more processors, cause an electronic device to perform the method described in one or more of the foregoing embodiments. In the embodiments of the present application, the electronic devices include various types of devices such as terminal devices and servers (clusters).
本公开的实施例可被实现为使用任意适当的硬件,固件,软件,或及其任意组合进行想要的配置的装置,该装置可包括终端设备、服务端(集群)等电子设备。图14示意性地示出了可被用于实现本申请中所述的各个实施例的示例性装置1400。Embodiments of the present disclosure can be implemented as an apparatus using any suitable hardware, firmware, software, or any combination thereof to perform the desired configuration, and the apparatus may include electronic equipment such as terminal equipment, server (cluster), and the like. FIG. 14 schematically illustrates an
对于一个实施例,图14示出了示例性装置1400,该装置具有一个或多个处理器1402、被耦合到(一个或多个)处理器1402中的至少一个的控制模块(芯片组)1404、被耦合到控制模块1404的存储器1406、被耦合到控制模块1404的非易失性存储器(NVM)/存储设备1408、被耦合到控制模块1404的一个或多个输入/输出设备1410,以及被耦合到控制模块1404的网络接口1412。For one embodiment, FIG. 14 illustrates an
处理器1402可包括一个或多个单核或多核处理器,处理器1402可包括通用处理器或专用处理器(例如图形处理器、应用处理器、基频处理器等)的任意组合。在一些实施例中,装置1400能够作为本申请实施例中所述终端设备、服务端(集群)等设备。
在一些实施例中,装置1400可包括具有指令1414的一个或多个计算机可读介质(例如,存储器1406或NVM/存储设备1408)以及与该一个或多个计算机可读介质相合并被配置为执行指令1414以实现模块从而执行本公开中所述的动作的一个或多个处理器1402。In some embodiments,
对于一个实施例,控制模块1404可包括任意适当的接口控制器,以向(一个或多个)处理器1402中的至少一个和/或与控制模块1404通信的任意适当的设备或组件提供任意适当的接口。For one embodiment, the
控制模块1404可包括存储器控制器模块,以向存储器1406提供接口。存储器控制器模块可以是硬件模块、软件模块和/或固件模块。
存储器1406可被用于例如为装置1400加载和存储数据和/或指令1414。对于一个实施例,存储器1406可包括任意适当的易失性存储器,例如,适当的DRAM。在一些实施例中,存储器1406可包括双倍数据速率类型四同步动态随机存取存储器(DDR4SDRAM)。Memory 1406 may be used, for example, to load and store data and/or instructions 1414 for
对于一个实施例,控制模块1404可包括一个或多个输入/输出控制器,以向NVM/存储设备1408及(一个或多个)输入/输出设备1410提供接口。For one embodiment,
例如,NVM/存储设备1408可被用于存储数据和/或指令1414。NVM/存储设备1408可包括任意适当的非易失性存储器(例如,闪存)和/或可包括任意适当的(一个或多个)非易失性存储设备(例如,一个或多个硬盘驱动器(HDD)、一个或多个光盘(CD)驱动器和/或一个或多个数字通用光盘(DVD)驱动器)。For example, NVM/
NVM/存储设备1408可包括在物理上作为装置1400被安装在其上的设备的一部分的存储资源,或者其可被该设备访问可不必作为该设备的一部分。例如,NVM/存储设备1408可通过网络经由(一个或多个)输入/输出设备1410进行访问。The NVM/
(一个或多个)输入/输出设备1410可为装置1400提供接口以与任意其他适当的设备通信,输入/输出设备1410可以包括通信组件、音频组件、传感器组件等。网络接口1412可为装置1400提供接口以通过一个或多个网络通信,装置1400可根据一个或多个无线网络标准和/或协议中的任意标准和/或协议来与无线网络的一个或多个组件进行无线通信,例如接入基于通信标准的无线网络,如WiFi、2G、3G、4G、5G等,或它们的组合进行无线通信。Input/output device(s) 1410 may provide an interface for
对于一个实施例,(一个或多个)处理器1402中的至少一个可与控制模块1404的一个或多个控制器(例如,存储器控制器模块)的逻辑封装在一起。对于一个实施例,(一个或多个)处理器1402中的至少一个可与控制模块1404的一个或多个控制器的逻辑封装在一起以形成系统级封装(SiP)。对于一个实施例,(一个或多个)处理器1402中的至少一个可与控制模块1404的一个或多个控制器的逻辑集成在同一模具上。对于一个实施例,(一个或多个)处理器1402中的至少一个可与控制模块1404的一个或多个控制器的逻辑集成在同一模具上以形成片上系统(SoC)。For one embodiment, at least one of the processor(s) 1402 may be packaged with the logic of one or more controllers (eg, memory controller modules) of the
在各个实施例中,装置1400可以但不限于是:服务端、台式计算设备或移动计算设备(例如,膝上型计算设备、手持计算设备、平板电脑、上网本等)等终端设备。在各个实施例中,装置1400可具有更多或更少的组件和/或不同的架构。例如,在一些实施例中,装置1400包括一个或多个摄像机、键盘、液晶显示器(LCD)屏幕(包括触屏显示器)、非易失性存储器端口、多个天线、图形芯片、专用集成电路(ASIC)和扬声器。In various embodiments, the
其中,检测装置中可采用主控芯片作为处理器或控制模块,传感器数据、位置信息等存储到存储器或NVM/存储设备中,传感器组可作为输入/输出设备,通信接口可包括包括网络接口。Among them, the main control chip can be used as the processor or control module in the detection device, the sensor data, location information, etc. are stored in the memory or NVM/storage device, the sensor group can be used as an input/output device, and the communication interface can include a network interface.
对于装置实施例而言,由于其与方法实施例基本相似,所以描述的比较简单,相关之处参见方法实施例的部分说明即可。As for the apparatus embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and reference may be made to the partial description of the method embodiment for related parts.
本说明书中的各个实施例均采用递进的方式描述,每个实施例重点说明的都是与其他实施例的不同之处,各个实施例之间相同相似的部分互相参见即可。The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same and similar parts between the various embodiments may be referred to each other.
本申请实施例是参照根据本申请实施例的方法、终端设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理终端设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理终端设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。The embodiments of the present application are described with reference to the flowcharts and/or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present application. It will be understood that each process and/or block in the flowchart illustrations and/or block diagrams, and combinations of processes and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to the processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing terminal equipment to produce a machine that causes the instructions to be executed by the processor of the computer or other programmable data processing terminal equipment Means are created for implementing the functions specified in the flow or flows of the flowcharts and/or the blocks or blocks of the block diagrams.
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理终端设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。These computer program instructions may also be stored in a computer readable memory capable of directing a computer or other programmable data processing terminal equipment to operate in a particular manner, such that the instructions stored in the computer readable memory result in an article of manufacture comprising instruction means, the The instruction means implement the functions specified in the flow or flow of the flowcharts and/or the block or blocks of the block diagrams.
这些计算机程序指令也可装载到计算机或其他可编程数据处理终端设备上,使得在计算机或其他可编程终端设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程终端设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions can also be loaded on a computer or other programmable data processing terminal equipment, so that a series of operational steps are performed on the computer or other programmable terminal equipment to produce a computer-implemented process, thereby executing on the computer or other programmable terminal equipment The instructions executed on the above provide steps for implementing the functions specified in the flowchart or blocks and/or the block or blocks of the block diagrams.
尽管已描述了本申请实施例的优选实施例,但本领域内的技术人员一旦得知了基本创造性概念,则可对这些实施例做出另外的变更和修改。所以,所附权利要求意欲解释为包括优选实施例以及落入本申请实施例范围的所有变更和修改。Although the preferred embodiments of the embodiments of the present application have been described, those skilled in the art may make additional changes and modifications to these embodiments once the basic inventive concepts are known. Therefore, the appended claims are intended to be construed to include the preferred embodiments as well as all changes and modifications that fall within the scope of the embodiments of the present application.
最后,还需要说明的是,在本文中,诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者终端设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者终端设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的过程、方法、物品或者终端设备中还存在另外的相同要素。Finally, it should also be noted that in this document, relational terms such as first and second are used only to distinguish one entity or operation from another, and do not necessarily require or imply these entities or that there is any such actual relationship or sequence between operations. Moreover, the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion, such that a process, method, article or terminal device comprising a list of elements includes not only those elements, but also a non-exclusive list of elements. other elements, or also include elements inherent to such a process, method, article or terminal equipment. Without further limitation, an element defined by the phrase "comprises a..." does not preclude the presence of additional identical elements in the process, method, article or terminal device comprising said element.
以上对本申请所提供的一种数据处理方法和装置,一种音箱设备,一种电子设备和一种存储介质,进行了详细介绍,本文中应用了具体个例对本申请的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本申请的方法及其核心思想;同时,对于本领域的一般技术人员,依据本申请的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本申请的限制。A data processing method and device, a sound box device, an electronic device, and a storage medium provided in the present application have been described above in detail. The principles and implementations of the present application are described in this paper using specific examples. Explanation, the description of the above embodiment is only used to help understand the method and the core idea of the application; meanwhile, for those of ordinary skill in the art, according to the idea of the application, there will be changes in the specific implementation and application scope. In conclusion, the content of this specification should not be construed as a limitation to the present application.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910473390.7ACN112015567B (en) | 2019-05-31 | 2019-05-31 | Data processing method, device, equipment and storage medium |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910473390.7ACN112015567B (en) | 2019-05-31 | 2019-05-31 | Data processing method, device, equipment and storage medium |
| Publication Number | Publication Date |
|---|---|
| CN112015567Atrue CN112015567A (en) | 2020-12-01 |
| CN112015567B CN112015567B (en) | 2025-02-18 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910473390.7AActiveCN112015567B (en) | 2019-05-31 | 2019-05-31 | Data processing method, device, equipment and storage medium |
| Country | Link |
|---|---|
| CN (1) | CN112015567B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114120998A (en)* | 2021-10-29 | 2022-03-01 | 青岛海尔科技有限公司 | Interactive content presentation method and device |
| CN115499894A (en)* | 2022-09-15 | 2022-12-20 | 深圳艾灵网络有限公司 | Network slice adjusting method, device and equipment |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103763691A (en)* | 2014-02-13 | 2014-04-30 | 上海温光自动化技术有限公司 | Intelligent terminal device voice conversation method and system |
| CN104301399A (en)* | 2014-09-28 | 2015-01-21 | 深圳市星盘科技有限公司 | System and method for remotely controlling loudspeaker box through voice |
| CN104540071A (en)* | 2014-12-08 | 2015-04-22 | 广东欧珀移动通信有限公司 | Communication switching method and device of smart sound box |
| WO2018102980A1 (en)* | 2016-12-06 | 2018-06-14 | 吉蒂机器人私人有限公司 | Speech interaction method, device and system |
| CN108320745A (en)* | 2018-02-08 | 2018-07-24 | 北京小米移动软件有限公司 | Control the method and device of display |
| CN108449664A (en)* | 2018-05-14 | 2018-08-24 | 中山市悦辰电子实业有限公司 | A multi-directional wireless charging speaker |
| CN108831449A (en)* | 2018-03-28 | 2018-11-16 | 上海与德科技有限公司 | A kind of data interaction system method and system based on intelligent sound box |
| CN108899020A (en)* | 2018-05-29 | 2018-11-27 | 北京小米移动软件有限公司 | Information search method, device and computer readable storage medium |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103763691A (en)* | 2014-02-13 | 2014-04-30 | 上海温光自动化技术有限公司 | Intelligent terminal device voice conversation method and system |
| CN104301399A (en)* | 2014-09-28 | 2015-01-21 | 深圳市星盘科技有限公司 | System and method for remotely controlling loudspeaker box through voice |
| CN104540071A (en)* | 2014-12-08 | 2015-04-22 | 广东欧珀移动通信有限公司 | Communication switching method and device of smart sound box |
| WO2018102980A1 (en)* | 2016-12-06 | 2018-06-14 | 吉蒂机器人私人有限公司 | Speech interaction method, device and system |
| CN108320745A (en)* | 2018-02-08 | 2018-07-24 | 北京小米移动软件有限公司 | Control the method and device of display |
| CN108831449A (en)* | 2018-03-28 | 2018-11-16 | 上海与德科技有限公司 | A kind of data interaction system method and system based on intelligent sound box |
| CN108449664A (en)* | 2018-05-14 | 2018-08-24 | 中山市悦辰电子实业有限公司 | A multi-directional wireless charging speaker |
| CN108899020A (en)* | 2018-05-29 | 2018-11-27 | 北京小米移动软件有限公司 | Information search method, device and computer readable storage medium |
| Title |
|---|
| SAMLEO L. JOSEPH ETC.: "Being Aware of the World: Toward Using Social Media to Support the Blind With Navigation", IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 14 January 2015 (2015-01-14)* |
| 刘华;田占生;冯宇飞;: "基于树莓派的智能家居语音控制系统", 制造业自动化, no. 10, 25 October 2018 (2018-10-25)* |
| 喻国明 等: "平台型智能媒介的机制构建与评估方法——以智能音箱为例", 新疆师范大学学报(哲学社会科学版), vol. 40, no. 2, 22 October 2018 (2018-10-22)* |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114120998A (en)* | 2021-10-29 | 2022-03-01 | 青岛海尔科技有限公司 | Interactive content presentation method and device |
| CN115499894A (en)* | 2022-09-15 | 2022-12-20 | 深圳艾灵网络有限公司 | Network slice adjusting method, device and equipment |
| CN115499894B (en)* | 2022-09-15 | 2024-07-02 | 深圳艾灵网络有限公司 | Network slice adjustment method, device and equipment |
| Publication number | Publication date |
|---|---|
| CN112015567B (en) | 2025-02-18 |
| Publication | Publication Date | Title |
|---|---|---|
| JP7160967B2 (en) | Keyphrase detection with audio watermark | |
| KR102660922B1 (en) | Management layer for multiple intelligent personal assistant services | |
| US20180204569A1 (en) | Voice Assistant Tracking And Activation | |
| US20170046124A1 (en) | Responding to Human Spoken Audio Based on User Input | |
| JP2020016875A (en) | Voice interaction method, apparatus, equipment, computer storage medium, and computer program | |
| WO2020078300A1 (en) | Method for controlling screen projection of terminal and terminal | |
| CN107481721A (en) | Voice interaction method for wearable electronic device and wearable electronic device | |
| US12374336B2 (en) | Combining device or assistant-specific hotwords in a single utterance | |
| CN111640434A (en) | Method and apparatus for controlling voice device | |
| US10997963B1 (en) | Voice based interaction based on context-based directives | |
| US20180367669A1 (en) | Input during conversational session | |
| CN112312368B (en) | Data processing method, device, equipment and storage medium | |
| CN112015567B (en) | Data processing method, device, equipment and storage medium | |
| US20170163497A1 (en) | Portable speaker | |
| CN105721886B (en) | A kind of audio-frequency information display methods, device and playback equipment |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |