Disclosure of Invention
One of the purposes of the invention is to provide a human-computer visual interaction analysis and control system for different service scenes, so as to realize the switching and the requirements of adapting to different service scenes and avoid the need of installing new program software when a user wants to use other scenes.
The embodiment of the invention provides a human-computer visual interaction analysis and control system for different service scenes, which comprises: a client and a server;
the client performs the following operations:
receiving the calling operation of a visual operation interface of a user;
analyzing the calling operation to obtain calling information;
the calling information is sent to a server, and visual operation interface data sent by the server is received;
operating the visual interface data to generate a visual interface;
and carrying out visual interactive analysis and operation on the data collected by the client based on the visual interface.
Preferably, the receiving of the invoking operation of the visual operation interface of the user includes:
receiving data to be visualized and input by a user;
and/or the presence of a gas in the gas,
receiving a calling word of a visual operation interface input by a user;
and/or the presence of a gas in the gas,
receiving a visual icon corresponding to a selection interface clicked by a user on the visual operation interface;
and/or the presence of a gas in the gas,
and receiving a preset shortcut calling operation key of the visual operation interface input by a user.
Preferably, the client further performs the following operations:
when the user closes the visual interface, outputting inquiry information whether to be stored to the local;
and when a saving instruction input by a user is received, saving the visual interface data into the local memory and generating a corresponding visual icon on the selection interface.
Preferably, analyzing the invoking operation to obtain invoking information includes:
taking data to be visualized as calling information;
and/or the presence of a gas in the gas,
taking the calling word as calling information;
and/or the presence of a gas in the gas,
taking the icon number corresponding to the visual icon as calling information;
and/or the presence of a gas in the gas,
and taking the quick calling operation key as calling information.
Preferably, when the calling information is to-be-processed visual data;
the server performs the following operations:
acquiring a preset analysis library, wherein analysis vectors in the analysis library correspond to visual operation interface data one to one;
performing feature extraction on visual data to be processed to obtain a plurality of feature values;
constructing a template and a characteristic value based on a preset vector, and constructing a data vector;
matching the data vectors with analysis vectors in an analysis library one by one to obtain visual operation interface data corresponding to the analysis vectors matched with the data vectors;
analyzing the visual operation interface data to obtain a corresponding interface number;
sending the interface number to the client; the client inquires a local memory, when the visual interface data corresponding to the interface number is inquired, the client directly calls the visual interface data from the local memory, otherwise, the client sends a data acquisition instruction to the server;
when a data acquisition instruction is received, sending the visual operation interface data to a client;
wherein, carry out the one-to-one matching with the analysis vector in data vector and the analysis storehouse, obtain the visual operation interface data that the analysis vector that matches accords with corresponds, include:
and calculating the matching degree of the data vector and the analysis vector, wherein the calculation formula is as follows:
wherein, MA is the matching degree of the data vector and the analysis vector, and n is the data dimension of the data vector or the data dimension of the analysis vector; sigmaiA value of the ith dimension data being a data vector; deltaiThe value of the ith dimension data which is the analysis vector;
and comparing the matching degrees of each analysis vector and the data vector in the analysis library, wherein when the maximum matching degree is greater than a preset threshold value, the analysis vector corresponding to the maximum matching degree is determined to be matched with the data vector.
Preferably, when no matching terms with the analysis vectors exist in the analysis library,
the server performs the following operations:
acquiring shared information of other clients connected to a server;
analyzing the shared information, and acquiring an identification vector corresponding to the shared visual operation interface data;
matching the identification vector with the data vector, and establishing data connection between the client and other clients when the identification vector is matched with the data vector;
screening out visual operation interface data to be selected based on the matching degree of the data vector and the analysis vector and the matching degree of the data vector and the identification vector when no matching coincidence item exists;
acquiring description information of visual operation interface data to be selected, and constructing a list to be selected;
sending the list to be selected to the client and receiving the selection operation of the user;
and sending the corresponding visual operation interface data to the client based on the selection operation of the user.
Preferably, when there are a plurality of matching coincident analysis vectors in the analysis library;
the server performs the following operations:
acquiring historical calling data of a client;
analyzing historical calling data, acquiring visual operation interface data of the historical calling as reference data, and constructing a reference data set;
acquiring visual operation interface data corresponding to the analysis vector as to-be-selected data, and constructing a to-be-selected data set;
respectively calculating the similarity between each piece of data to be selected in the data set to be selected and each piece of reference data in the reference data set;
sorting the similarity from big to small; when the difference value between the maximum similarity and the second maximum similarity is larger than or equal to a preset difference value threshold value, acquiring the data to be selected corresponding to the maximum similarity and sending the data to the client; and/or calculating the sum of the similarity of the data to be selected and each reference data in the reference data set, acquiring the data to be selected with the maximum sum, and sending the data to the client.
The invention also provides a human-computer visual interaction analysis and control method for different service scenes, which is applied to a client and comprises the following steps:
receiving the calling operation of a visual operation interface of a user;
analyzing the calling operation to obtain calling information;
the calling information is sent to a server, and visual operation interface data sent by the server is received;
operating the visual interface data to generate a visual interface;
and carrying out visual interactive analysis and operation on the data collected by the client based on the visual interface.
Preferably, the receiving of the invoking operation of the visual operation interface of the user includes:
receiving data to be visualized and input by a user;
and/or the presence of a gas in the gas,
receiving a calling word of a visual operation interface input by a user;
and/or the presence of a gas in the gas,
receiving a visual icon corresponding to a selection interface clicked by a user on the visual operation interface;
and/or the presence of a gas in the gas,
and receiving a preset shortcut calling operation key of the visual operation interface input by a user.
Preferably, the method for analyzing and controlling human-computer visual interaction in different service scenarios further includes:
when the user closes the visual interface, outputting inquiry information whether to be stored to the local;
and when a saving instruction input by a user is received, saving the visual interface data into the local memory and generating a corresponding visual icon on the selection interface.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
The technical solution of the present invention is further described in detail by the accompanying drawings and embodiments.
Detailed Description
The preferred embodiments of the present invention will be described in conjunction with the accompanying drawings, and it will be understood that they are described herein for the purpose of illustration and explanation and not limitation.
The embodiment of the invention provides a human-computer visual interaction analysis and control system for different service scenes, as shown in fig. 1, comprising: a client and a server;
the client performs the following operations:
receiving the calling operation of a visual operation interface of a user;
analyzing the calling operation to obtain calling information;
the calling information is sent to a server, and visual operation interface data sent by the server is received;
operating the visual interface data to generate a visual interface;
and carrying out visual interactive analysis and operation on the data collected by the client based on the visual interface.
The working principle and the beneficial effects of the technical scheme are as follows:
the method comprises the steps that a user carries out calling operation on a visual operation interface, corresponding visual operation interface data are called from a server according to the calling operation of the user, a visual operation interface is generated, and analysis, interactive operation and the like of the data of the user are achieved through the visual operation interface; different service scenes correspond to different calling operations; the method realizes the quick switching when a user wants to use various service scenes; the calling operation is carried out on the same visual operation interface for multiple times; therefore, the use of various service scenes is realized without installing new program software. The service scene comprises the following steps: the intelligent manufacturing system comprises intelligent manufacturing, green energy, intelligent logistics, intelligent finance, a smart city, a smart government affair and the like, wherein the intelligent manufacturing is used for constructing an auxiliary intelligent decision-making service environment which takes a leading enterprise as a core and takes upstream and downstream enterprises as a digital twin of 'people-information-equipment' in an information space, and is used for forecasting in advance, supervising in advance and pursuing after the fact. The green energy has the functions of realizing visual analysis, twin service, remote diagnosis and active early warning of equipment, visual analysis and control of the whole process, digital detection and the like. The intelligent logistics realizes the optimization and reconstruction of the logistics business process of the enterprise, realizes the intelligent management of vehicle personnel and the intelligent order management, improves the logistics efficiency and reduces the mobile capital backlog of the enterprise. The intelligent finance realizes functions of big data wind control, intelligent customer service and the like. The service efficiency of financial institutions is improved, the breadth and the depth of financial services are expanded, and the intellectualization, the individualization and the customization of the financial services are realized. The smart city is intelligent for realizing city management. Real-time management of equipment and infrastructure implementations, particularly public industries of transportation, energy, commerce, security, medical, and the like. The intelligent government affairs are comprehensively popularized and applied in the fields of public utilities, municipal administration, urban and rural environments, rural life, health care, disaster reduction and relief, social assistance, old-age care service, labor employment, social security, cultural education, traffic tourism, quality safety, consumption right, community service and the like.
In one embodiment, receiving a retrieval operation of a visual operation interface of a user comprises:
receiving data to be visualized and input by a user;
and/or the presence of a gas in the gas,
receiving a calling word of a visual operation interface input by a user;
and/or the presence of a gas in the gas,
receiving a visual icon corresponding to a selection interface clicked by a user on the visual operation interface;
and/or the presence of a gas in the gas,
and receiving a preset shortcut calling operation key of the visual operation interface input by a user.
The working principle and the beneficial effects of the technical scheme are as follows:
receiving the calling operation of a visual operation interface of a user, mainly through the following ways; firstly, a user directly inputs or copies and drags data to be visualized into a first preset area of a visualized operation interface, and directly generates calling operation by the data to be visualized; and secondly, inputting a preset calling word in an input area of the visual operation interface. Thirdly, in order to preset a visual icon on the visual operation interface, the user can complete the calling operation by clicking the corresponding visual icon. Fourthly, when the visual operation interface is the current interface, the quick calling operation keys are input through a computer keyboard, and the requirements of users with different input preferences are met through setting of diversified input ways of calling operation.
In one embodiment, the client further performs the following operations:
when the user closes the visual interface, outputting inquiry information whether to be stored to the local;
and when a saving instruction input by a user is received, saving the visual interface data into the local memory and generating a corresponding visual icon on the selection interface.
The working principle and the beneficial effects of the technical scheme are as follows:
the common visual interface is locally stored, so that the next quick calling of the user is realized, and the calling load of the server is reduced. And generating a corresponding visual icon on the selection interface; the user only needs to click the visual icon when calling next time.
In one embodiment, parsing the call operation to obtain call information includes:
taking data to be visualized as calling information;
and/or the presence of a gas in the gas,
taking the calling word as calling information;
and/or the presence of a gas in the gas,
taking the icon number corresponding to the visual icon as calling information;
and/or the presence of a gas in the gas,
and taking the quick calling operation key as calling information.
The working principle and the beneficial effects of the technical scheme are as follows:
analyzing the calling operation to obtain calling information; respectively generating different calling information aiming at four different calling operation acquisition modes; respectively are data to be visualized, a calling word, an icon number and a quick calling key. The server can analyze the visual interface information which is required to be called by the user by taking the data to be visually processed, the calling words, the icon numbers and the quick calling keys as calling information.
In one embodiment, when the calling information is visual data to be processed;
the server performs the following operations:
acquiring a preset analysis library, wherein analysis vectors in the analysis library correspond to visual operation interface data one to one;
performing feature extraction on visual data to be processed to obtain a plurality of feature values;
constructing a template and a characteristic value based on a preset vector, and constructing a data vector;
matching the data vectors with analysis vectors in an analysis library one by one to obtain visual operation interface data corresponding to the analysis vectors matched with the data vectors;
analyzing the visual operation interface data to obtain a corresponding interface number;
sending the interface number to the client; the client inquires a local memory, when the visual interface data corresponding to the interface number is inquired, the client directly calls the visual interface data from the local memory, otherwise, the client sends a data acquisition instruction to the server;
when a data acquisition instruction is received, sending the visual operation interface data to a client;
wherein, carry out the one-to-one matching with the analysis vector in data vector and the analysis storehouse, obtain the visual operation interface data that the analysis vector that matches accords with corresponds, include:
and calculating the matching degree of the data vector and the analysis vector, wherein the calculation formula is as follows:
wherein, MA is the matching degree of the data vector and the analysis vector, and n is the data dimension of the data vector or the data dimension of the analysis vector; sigmaiA value of the ith dimension data being a data vector; deltaiThe value of the ith dimension data which is the analysis vector;
and comparing the matching degrees of each analysis vector and the data vector in the analysis library, wherein when the maximum matching degree is greater than a preset threshold value, the analysis vector corresponding to the maximum matching degree is determined to be matched with the data vector.
The working principle and the beneficial effects of the technical scheme are as follows:
the visual interface data are obtained by directly transmitting the visual data to be processed to a server and analyzing the visual interface data by the server based on a preset analysis library; therefore, the user does not need to know some marks such as the type and the parameters of the visual interface data needing to be called, the visual operation process of the user is directly simplified, and the efficiency is improved.
In one embodiment, when there are no matching correspondences with the analysis vectors in the analysis library,
the server performs the following operations:
acquiring shared information of other clients connected to a server;
analyzing the shared information, and acquiring an identification vector corresponding to the shared visual operation interface data;
matching the identification vector with the data vector, and establishing data connection between the client and other clients when the identification vector is matched with the data vector;
screening out visual operation interface data to be selected based on the matching degree of the data vector and the analysis vector and the matching degree of the data vector and the identification vector when no matching coincidence item exists;
acquiring description information of visual operation interface data to be selected, and constructing a list to be selected;
sending the list to be selected to the client and receiving the selection operation of the user;
and sending the corresponding visual operation interface data to the client based on the selection operation of the user.
The working principle and the beneficial effects of the technical scheme are as follows:
when there is no visual interface desired by the user in the analysis library, sharing by other users may be possible, and of course sharing may be conditional, with the specific condition being resolved by the user and the shared user's business or agreement after the user connects with the shared user. And when no matching coincidence exists, comprehensively analyzing possible visual operation interface data and outputting the data to a user for selection. The screening condition is that the matching degree is less than or equal to a preset threshold value but greater than or equal to a possible threshold value representing possible; the possible threshold is less than a preset threshold.
In one embodiment, when there are multiple matching coincident analysis vectors in the analysis library;
the server performs the following operations:
acquiring historical calling data of a client;
analyzing historical calling data, acquiring visual operation interface data of the historical calling as reference data, and constructing a reference data set;
acquiring visual operation interface data corresponding to the analysis vector as to-be-selected data, and constructing a to-be-selected data set;
respectively calculating the similarity between each piece of data to be selected in the data set to be selected and each piece of reference data in the reference data set;
sorting the similarity from big to small; when the difference value between the maximum similarity and the second maximum similarity is larger than or equal to a preset difference value threshold value, acquiring the data to be selected corresponding to the maximum similarity and sending the data to the client; and/or calculating the sum of the similarity of the data to be selected and each reference data in the reference data set, acquiring the data to be selected with the maximum sum, and sending the data to the client.
The working principle and the beneficial effects of the technical scheme are as follows:
when a plurality of matching coincident items exist in calling, analyzing the historical calling record of the user, and obtaining the coincident items similar to the historical calling record of the user for calling so as to accord with the use habit of the visual interface of the user; whether the styles and the types of the visual interfaces conforming to the items are similar or not, whether the types of the visual interfaces are similar or not, whether the operation instructions are similar or not and the like are also considered.
The invention also provides a human-computer visual interaction analysis and control method for different service scenes, which is applied to a client and comprises the following steps:
receiving the calling operation of a visual operation interface of a user;
analyzing the calling operation to obtain calling information;
the calling information is sent to a server, and visual operation interface data sent by the server is received;
operating the visual interface data to generate a visual interface;
and carrying out visual interactive analysis and operation on the data collected by the client based on the visual interface.
The working principle and the beneficial effects of the technical scheme are as follows:
the method comprises the steps that a user carries out calling operation on a visual operation interface, corresponding visual operation interface data are called from a server according to the calling operation of the user, a visual operation interface is generated, and analysis, interactive operation and the like of the data of the user are achieved through the visual operation interface; different service scenes correspond to different calling operations; the method realizes the quick switching when a user wants to use various service scenes; the calling operation is carried out on the same visual operation interface for multiple times; therefore, the use of various service scenes is realized without installing new program software. The service scene comprises the following steps: the intelligent manufacturing system comprises intelligent manufacturing, green energy, intelligent logistics, intelligent finance, a smart city, a smart government affair and the like, wherein the intelligent manufacturing is used for constructing an auxiliary intelligent decision-making service environment which takes a leading enterprise as a core and takes upstream and downstream enterprises as a digital twin of 'people-information-equipment' in an information space, and is used for forecasting in advance, supervising in advance and pursuing after the fact. The green energy has the functions of realizing visual analysis, twin service, remote diagnosis and active early warning of equipment, visual analysis and control of the whole process, digital detection and the like. The intelligent logistics realizes the optimization and reconstruction of the logistics business process of the enterprise, realizes the intelligent management of vehicle personnel and the intelligent order management, improves the logistics efficiency and reduces the mobile capital backlog of the enterprise. The intelligent finance realizes functions of big data wind control, intelligent customer service and the like. The service efficiency of financial institutions is improved, the breadth and the depth of financial services are expanded, and the intellectualization, the individualization and the customization of the financial services are realized. The smart city is intelligent for realizing city management. Real-time management of equipment and infrastructure implementations, particularly public industries of transportation, energy, commerce, security, medical, and the like. The intelligent government affairs are comprehensively popularized and applied in the fields of public utilities, municipal administration, urban and rural environments, rural life, health care, disaster reduction and relief, social assistance, old-age care service, labor employment, social security, cultural education, traffic tourism, quality safety, consumption right, community service and the like.
In one embodiment, receiving a retrieval operation of a visual operation interface of a user comprises:
receiving data to be visualized and input by a user;
and/or the presence of a gas in the gas,
receiving a calling word of a visual operation interface input by a user;
and/or the presence of a gas in the gas,
receiving a visual icon corresponding to a selection interface clicked by a user on the visual operation interface;
and/or the presence of a gas in the gas,
and receiving a preset shortcut calling operation key of the visual operation interface input by a user.
The working principle and the beneficial effects of the technical scheme are as follows:
receiving the calling operation of a visual operation interface of a user, mainly through the following ways; firstly, a user directly inputs or copies and drags data to be visualized into a first preset area of a visualized operation interface, and directly generates calling operation by the data to be visualized; and secondly, inputting a preset calling word in an input area of the visual operation interface. Thirdly, in order to preset a visual icon on the visual operation interface, the user can complete the calling operation by clicking the corresponding visual icon. Fourthly, when the visual operation interface is the current interface, the quick calling operation keys are input through a computer keyboard, and the requirements of users with different input preferences are met through setting of diversified input ways of calling operation.
In one embodiment, the method for analyzing and controlling human-computer visual interaction of different business scenarios further comprises:
when the user closes the visual interface, outputting inquiry information whether to be stored to the local;
and when a saving instruction input by a user is received, saving the visual interface data into the local memory and generating a corresponding visual icon on the selection interface.
The working principle and the beneficial effects of the technical scheme are as follows:
the common visual interface is locally stored, so that the next quick calling of the user is realized, and the calling load of the server is reduced. And generating a corresponding visual icon on the selection interface; the user only needs to click the visual icon when calling next time.
In one embodiment, parsing the call operation to obtain call information includes:
taking data to be visualized as calling information;
and/or the presence of a gas in the gas,
taking the calling word as calling information;
and/or the presence of a gas in the gas,
taking the icon number corresponding to the visual icon as calling information;
and/or the presence of a gas in the gas,
and taking the quick calling operation key as calling information.
The working principle and the beneficial effects of the technical scheme are as follows:
analyzing the calling operation to obtain calling information; respectively generating different calling information aiming at four different calling operation acquisition modes; respectively are data to be visualized, a calling word, an icon number and a quick calling key. The server can analyze the visual interface information which is required to be called by the user by taking the data to be visually processed, the calling words, the icon numbers and the quick calling keys as calling information.
In one embodiment, when the calling information is visual data to be processed;
the server performs the following operations:
acquiring a preset analysis library, wherein analysis vectors in the analysis library correspond to visual operation interface data one to one;
performing feature extraction on visual data to be processed to obtain a plurality of feature values;
constructing a template and a characteristic value based on a preset vector, and constructing a data vector;
matching the data vectors with analysis vectors in an analysis library one by one to obtain visual operation interface data corresponding to the analysis vectors matched with the data vectors;
analyzing the visual operation interface data to obtain a corresponding interface number;
sending the interface number to the client; the client inquires a local memory, when the visual interface data corresponding to the interface number is inquired, the client directly calls the visual interface data from the local memory, otherwise, the client sends a data acquisition instruction to the server;
when a data acquisition instruction is received, sending the visual operation interface data to a client;
wherein, carry out the one-to-one matching with the analysis vector in data vector and the analysis storehouse, obtain the visual operation interface data that the analysis vector that matches accords with corresponds, include:
and calculating the matching degree of the data vector and the analysis vector, wherein the calculation formula is as follows:
wherein, MA is the matching degree of the data vector and the analysis vector, and n is the data dimension of the data vector or the data dimension of the analysis vector; sigmaiA value of the ith dimension data being a data vector; deltaiThe value of the ith dimension data which is the analysis vector;
and comparing the matching degrees of each analysis vector and the data vector in the analysis library, wherein when the maximum matching degree is greater than a preset threshold value, the analysis vector corresponding to the maximum matching degree is determined to be matched with the data vector.
The working principle and the beneficial effects of the technical scheme are as follows:
the visual interface data are obtained by directly transmitting the visual data to be processed to a server and analyzing the visual interface data by the server based on a preset analysis library; therefore, the user does not need to know some marks such as the type and the parameters of the visual interface data needing to be called, the visual operation process of the user is directly simplified, and the efficiency is improved.
In one embodiment, when there are no matching correspondences with the analysis vectors in the analysis library,
the server performs the following operations:
acquiring shared information of other clients connected to a server;
analyzing the shared information, and acquiring an identification vector corresponding to the shared visual operation interface data;
matching the identification vector with the data vector, and establishing data connection between the client and other clients when the identification vector is matched with the data vector;
screening out visual operation interface data to be selected based on the matching degree of the data vector and the analysis vector and the matching degree of the data vector and the identification vector when no matching coincidence item exists;
acquiring description information of visual operation interface data to be selected, and constructing a list to be selected;
sending the list to be selected to the client and receiving the selection operation of the user;
and sending the corresponding visual operation interface data to the client based on the selection operation of the user.
The working principle and the beneficial effects of the technical scheme are as follows:
when there is no visual interface desired by the user in the analysis library, sharing by other users may be possible, and of course sharing may be conditional, with the specific condition being resolved by the user and the shared user's business or agreement after the user connects with the shared user. And when no matching coincidence exists, comprehensively analyzing possible visual operation interface data and outputting the data to a user for selection. The screening condition is that the matching degree is less than or equal to a preset threshold value but greater than or equal to a possible threshold value representing possible; the possible threshold is less than a preset threshold.
In one embodiment, when there are multiple matching coincident analysis vectors in the analysis library;
the server performs the following operations:
acquiring historical calling data of a client;
analyzing historical calling data, acquiring visual operation interface data of the historical calling as reference data, and constructing a reference data set;
acquiring visual operation interface data corresponding to the analysis vector as to-be-selected data, and constructing a to-be-selected data set;
respectively calculating the similarity between each piece of data to be selected in the data set to be selected and each piece of reference data in the reference data set;
sorting the similarity from big to small; when the difference value between the maximum similarity and the second maximum similarity is larger than or equal to a preset difference value threshold value, acquiring the data to be selected corresponding to the maximum similarity and sending the data to the client; and/or calculating the sum of the similarity of the data to be selected and each reference data in the reference data set, acquiring the data to be selected with the maximum sum, and sending the data to the client.
The working principle and the beneficial effects of the technical scheme are as follows:
when a plurality of matching coincident items exist in calling, analyzing the historical calling record of the user, and obtaining the coincident items similar to the historical calling record of the user for calling so as to accord with the use habit of the visual interface of the user; whether the styles and the types of the visual interfaces conforming to the items are similar or not, whether the types of the visual interfaces are similar or not, whether the operation instructions are similar or not and the like are also considered.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.