Infrared remote controller learning method and system based on machine learning algorithmTechnical Field
The invention relates to the technical field of infrared remote control learning, in particular to an infrared remote controller learning method and system based on a machine learning algorithm.
Background
At present, televisions in families are usually externally connected with other devices such as a television set top box, a wireless television set top box, a satellite television set top box, an OTT box, an IPTV, a video recorder, a VCD/DVD and the like to watch television programs or video and audio contents. The common household television is an intelligent television, and can watch network videos, games and the like, and the television is provided with a special remote controller, usually a Bluetooth remote controller, and has a voice function and the like. The television external equipment (peripheral for short) also has a special remote controller, which is usually an infrared remote controller. In the process of remote control operation, a user needs to use two different remote controllers to respectively control a television or a peripheral, so that the situation that the remote controllers and equipment are not corresponding to each other and cannot be controlled easily occurs, and the problem that the peripheral remote controllers cannot be found or cannot be remotely controlled after being damaged easily exists.
In the modern times of popularization of smart televisions, televisions gradually become smart home control centers, and interaction by utilizing a television remote controller and external infrared equipment becomes a strong demand of users. I.e. the television remote control is a universal remote control for infrared devices. But the process of learning the infrared remote controller is needed before the television remote controller controls other infrared devices.
At present, if a learning remote controller needs to have partial key functions of a television remote controller or a peripheral remote controller, a user is required to learn codes through a complicated remote controller, the learning process of the infrared remote controller is time-consuming and labor-consuming, and therefore the infrared remote controller capable of automatically learning and identifying television external equipment is needed.
Disclosure of Invention
The invention provides an infrared remote controller learning method and system based on a machine learning algorithm, which adopts a machine learning multi-classification algorithm technology based on artificial intelligence to solve the problem of automatically identifying an infrared remote controller of a television external device.
The technical scheme adopted by the invention is as follows: the infrared remote controller learning method based on the machine learning algorithm comprises the following steps:
s1, data collection and ETL: collecting the use behavior data of infrared remote controllers of a large number of users and the data of external equipment; constructing an infrared remote controller model library and an infrared remote control protocol library; carrying out data characteristic engineering processing to construct a sample data set;
s2, model training: constructing a multi-classification deep neural network for remote controller identification; training and verifying the infrared remote controller multi-classification algorithm network by using the Tensorflow and the sample data set, and generating an infrared remote controller model identification model;
s3, model deployment: deploying a prediction service of an infrared remote controller model identification model by using TF Serving and docker;
s4, recognizing by an infrared remote controller of external equipment: the intelligent television terminal collects sample characteristic information and requests an infrared remote controller model identification model of an online Tensorflow Serving service.
As a preferable mode of the infrared remote controller learning method based on the machine learning algorithm, the infrared remote controller usage behavior data in S1 includes:
the type of the infrared remote controller, the key information, the infrared remote controller signal corresponding to the key, the protocol information used by the infrared remote controller, and the appearance image of the infrared remote controller.
As a preferable mode of the infrared remote controller learning method based on the machine learning algorithm, the external device data in S1 includes:
the method comprises the steps of starting up pictures of the external equipment, menus of the external equipment, key signals of a remote controller of the external equipment, the type of an output interface of the external equipment, the use duration of the external equipment, the information acquisition of the use time period of the external equipment, the geographic position information and the ASN attribution information.
As a preferable mode of the infrared remote controller learning method based on the machine learning algorithm, in S1, an infrared remote controller model library and an infrared remote control protocol library are constructed; performing data characteristic engineering processing, and specifically constructing a sample data set comprises:
s1.1, establishing an infrared remote controller model base, an infrared remote control protocol base and scanning configuration information at a cloud end according to the infrared remote controller model, the protocol information used by the infrared remote controller and the infrared remote controller key signal data;
s1.2, under an external equipment source, according to scanning configuration of a cloud, an infrared receiving module of the intelligent television terminal tries different protocols and detects whether infrared signals of different keys exist or not; meanwhile, signals of the infrared remote controller keys are collected and uploaded to a cloud end, and the infrared remote controller model index is obtained through an infrared remote controller model library;
s1.3, performing data characteristic engineering processing by using a Hadoop big data platform to form a sample data set, and dividing the sample data set into a model training set and a verification set.
As a preferable mode of the infrared remote controller learning method based on the machine learning algorithm, the S2 includes:
s2.1, converting the training sample data set into a data set in a TFRecord format;
s2.2, training a VGG16 network by using the collected data sets of the startup picture, the appearance image and the infrared remote controller appearance image of the external equipment of the intelligent television;
and S2.3, training and generating an infrared remote controller model identification model by combining the geographical position information of the sample data set, the ASN attribution information, the type of an output interface of the external equipment, the use duration of the external equipment and the use time period of the external equipment with the characteristics of S2.2 through a multi-classification algorithm network structure of the infrared remote controller.
As a preferable mode of the infrared remote controller learning method based on the machine learning algorithm, the S3 includes:
s3.1, periodically synchronizing an infrared remote controller model identification model generated by a tensoflow platform on an algorithm server for model training to a docker server;
and S3.2, creating a container on the Docker server through an open-source application container engine Docker, and operating Tensflow Serving service in the container, so that the trained infrared remote controller model identification model is directly on line and provides service.
As a preferable mode of the infrared remote controller learning method based on the machine learning algorithm, the S4 includes:
s4.1, acquiring local MAC (media access control) information, an external equipment input interface, an external equipment input type, a geographic position, an ASN (access network) attribution, the weekly use duration of the external equipment, the common time period of the external equipment, a starting image of the external equipment, an appearance image of the external equipment and a remote controller image of the external equipment by the intelligent television terminal;
s4.2, acquiring image number information of the external equipment startup image, the external equipment appearance image and the external equipment remote controller image which are acquired in the S4.1 through a corresponding VGG16 network;
s4.3, transmitting the characteristic information of the S4.1 and the S4.2 to an infrared remote controller model identification model of a Tensflow Serving service of the docker server, and acquiring the serial number of the infrared remote controller model;
s4.4, acquiring the corresponding infrared remote controller information from the serial number of the infrared remote controller model acquired in the S4.3 through an infrared remote controller model library of a far-end server;
and S4.5, the Bluetooth remote controller of the intelligent television terminal acquires the infrared remote controller information through S4.4 and controls the external infrared equipment of the television through the information.
The invention also provides an infrared remote controller learning system based on the machine learning algorithm, which comprises an artificial intelligence server, an intelligent television with a camera, a television remote controller, an intelligent television external device and an external device remote controller;
the television remote control is a Bluetooth remote controller, and an infrared signal coding module, an infrared signal modulation module and an infrared signal transmitting module are installed on the television remote control;
an infrared receiving connector is mounted on the intelligent television;
the artificial intelligence server comprises a hadoop big data platform, a Tensorflow end-to-end open source machine learning platform training server and a docker model prediction server;
the system realizes the rapid automatic learning of the Bluetooth remote controller of the intelligent television to the external infrared remote controller of the intelligent television through the infrared remote controller learning method based on the machine learning algorithm.
The invention has the beneficial effects that: according to the infrared remote controller intelligent automatic learning system, the intelligent television and the television remote controller are matched to construct the infrared remote controller intelligent automatic learning system through the artificial intelligent server (algorithms such as image recognition, multi-classification and scene recognition) on the cloud, a user does not need to perform a complicated remote controller code matching learning process, the system automatically learns the key codes and the corresponding functions of the infrared remote controller of the external equipment of the intelligent television, and therefore the television and the external equipment are not required to be controlled in a distributed mode through two different remote controllers, and the television terminal and the external equipment connected with the television terminal can be controlled and managed in a unified mode through the television remote controller.
Drawings
Fig. 1 is a flow chart of the infrared remote controller identification of the external device disclosed by the invention.
FIG. 2 is a schematic diagram of a sample data set disclosed herein.
Fig. 3 is a network structure block diagram of the infrared remote controller recognition multi-classification algorithm disclosed by the invention.
Fig. 4 is a block diagram of the network structure of the VGG16 disclosed in the present invention.
Fig. 5 is a block diagram of an intelligent television module disclosed by the invention.
Fig. 6 is a system block diagram of an infrared remote controller learning system based on a machine learning algorithm disclosed by the present invention.
Fig. 7 is a block diagram of a bluetooth remote controller module of the smart television disclosed in the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer, the present invention will be described in further detail below with reference to the accompanying drawings, but embodiments of the present invention are not limited thereto.
Example 1:
referring to fig. 1, the present embodiment provides a learning method for an infrared remote controller based on a machine learning algorithm, including the following steps:
s1, data collection and ETL: collecting the use behavior data of infrared remote controllers of a large number of users and the data of external equipment; constructing an infrared remote controller model library and an infrared remote control protocol library; and carrying out data characteristic engineering processing to construct a sample data set.
Wherein the infrared remote controller uses the behavioral data to include: the type of the infrared remote controller, the key information, the infrared remote controller signal corresponding to the key, the protocol information used by the infrared remote controller, and the appearance image of the infrared remote controller.
The information of various external devices can be collected and collected manually, mainly including information of STB/IPTV set-top boxes of broadcasting and TV of various cities or IPTV boxes of various large telecom operators and OTT boxes of various large manufacturers. The external device data specifically includes: the method comprises the steps of starting up pictures of the external equipment, menus of the external equipment, key signals of a remote controller of the external equipment, the type of an output interface of the external equipment, the use duration of the external equipment, the information acquisition of the use time period of the external equipment, the geographic position information and the ASN attribution information.
In the S1, an infrared remote controller model library and an infrared remote control protocol library are constructed; performing data characteristic engineering processing, and specifically constructing a sample data set comprises:
s1.1, an infrared remote controller model base, an infrared remote control protocol base and scanning configuration information are constructed at the cloud according to the infrared remote controller model, the protocol information used by the infrared remote controller and the infrared remote controller key signal data.
S1.2, under an external equipment source, according to scanning configuration of a cloud, an infrared receiving module of the intelligent television terminal tries different protocols and detects whether infrared signals of different keys exist or not; and meanwhile, signals of the infrared remote controller keys are collected and uploaded to a cloud end, and the infrared remote controller model index is obtained through an infrared remote controller model library.
S1.3, performing data characteristic engineering processing by using a Hadoop big data platform to form a sample data set (an example of the data set is shown in figure 2), and dividing the sample data set into a model training set and a verification set.
S2, model training: constructing a multi-classification deep neural network for remote controller identification; and training and verifying the infrared remote controller multi-classification algorithm network by using Tensorflow (an end-to-end open source machine learning platform) and the sample data set, and generating an infrared remote controller model identification model. The network structure of the infrared remote controller multi-classification algorithm is shown in fig. 3, wherein V in fig. 3 represents weight, and X represents vector.
The S2 specifically includes:
and S2.1, converting the training sample data set into a data set in a TFRecord format.
S2.2, training the VGG16 network by using the collected data sets of the startup picture, the appearance image and the infrared remote controller appearance image of the external equipment of the intelligent television. The network structure block diagram of the VGG16 is shown in FIG. 4.
And S2.3, training and generating an infrared remote controller model identification model by combining the geographical position information of the sample data set, the ASN attribution information, the type of an output interface of the external equipment, the use duration of the external equipment and the use time period of the external equipment with the characteristics of S2.2 through a multi-classification algorithm network structure of the infrared remote controller.
S3, model deployment: and deploying the prediction service of the model identification model of the infrared remote controller by using TF Serving and docker.
The S3 specifically includes:
s3.1, regularly synchronizing an infrared remote controller model identification model generated by a tensoflow platform on an algorithm server for model training to a docker server.
And S3.2, creating a container on the Docker server through an open-source application container engine Docker, and operating Tensflow Serving service in the container, so that the trained infrared remote controller model identification model is directly on line and provides service.
S4, recognizing by an infrared remote controller of external equipment: the intelligent television terminal collects sample characteristic information and requests an infrared remote controller model identification model of an online Tensorflow Serving service.
The S4 specifically includes:
s4.1, acquiring local MAC (media access control) acquired by the intelligent television terminal (comprising a main module shown in figure 5), an external device input interface, an external device input type, a geographic position, an ASN (access service network) attribution, the weekly use duration of the external device, the common time period of the external device, a starting image of the external device, an appearance image of the external device and a remote controller image of the external device.
And S4.2, acquiring image number information of the external equipment startup image, the external equipment appearance image and the external equipment remote controller image which are acquired in the S4.1 through a corresponding VGG16 network.
And S4.3, transmitting the characteristic information of the S4.1 and the S4.2 to an infrared remote controller model identification model of a Tensflow Serving service of the docker server, and acquiring the serial number of the infrared remote controller model.
And S4.4, acquiring the corresponding infrared remote controller information from the serial number of the infrared remote controller acquired in the S4.3 through an infrared remote controller model library of the remote server.
And S4.5, the Bluetooth remote controller of the intelligent television terminal acquires the infrared remote controller information through S4.4 and controls the external infrared equipment of the television through the information.
Example 2
The embodiment discloses an infrared remote controller learning system based on a machine learning algorithm, as shown in fig. 6, which includes an artificial intelligence server, an intelligent television with a camera, a television remote controller, an external device of the intelligent television (IPTV/OTT/STB, etc.), and an external device remote controller (infrared remote controller).
The television remote control is a Bluetooth remote controller, and an infrared signal coding module, an infrared signal modulation module and an infrared signal transmitting module are installed on the television remote control. The block diagram of the smart television Bluetooth remote controller module is shown in FIG. 7.
An infrared receiving connector is installed on the smart television, and a block diagram of a smart television module is shown in fig. 5.
The artificial intelligence server comprises a hadoop big data platform, a Tensorflow end-to-end open source machine learning platform training server and a docker model prediction server.
An infrared remote controller is generally used by an external device of the smart television, such as an IPTV/OTT/STB, and a specific process of learning the external infrared remote controller by a bluetooth remote controller of the smart television is shown in fig. 1.
The system realizes the rapid and automatic learning of the external infrared remote controller of the intelligent television by the Bluetooth remote controller of the intelligent television through the infrared remote controller learning method based on the machine learning algorithm in theembodiment 1.
The above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.