CN113741397A - Performance test method and system of intelligent household equipment - Google Patents
Performance test method and system of intelligent household equipmentDownload PDFInfo
- Publication number
- CN113741397A CN113741397ACN202111054844.0ACN202111054844ACN113741397ACN 113741397 ACN113741397 ACN 113741397ACN 202111054844 ACN202111054844 ACN 202111054844ACN 113741397 ACN113741397 ACN 113741397A
- Authority
- CN
- China
- Prior art keywords
- intelligent household
- time
- household equipment
- equipment
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034methodMethods0.000titleclaimsabstractdescription33
- 238000011056performance testMethods0.000titleclaimsdescription5
- 238000007639printingMethods0.000claimsabstractdescription67
- 238000012360testing methodMethods0.000claimsabstractdescription45
- 238000004891communicationMethods0.000claimsabstractdescription11
- 230000004044responseEffects0.000claimsdescription36
- 238000012545processingMethods0.000claimsdescription11
- 238000012546transferMethods0.000claimsdescription11
- 238000012544monitoring processMethods0.000claimsdescription10
- 238000011156evaluationMethods0.000claimsdescription9
- 230000008569processEffects0.000claimsdescription7
- 230000006870functionEffects0.000claimsdescription5
- 238000011084recoveryMethods0.000claimsdescription3
- 230000003993interactionEffects0.000description4
- 238000010586diagramMethods0.000description2
- 238000010276constructionMethods0.000description1
- 238000005516engineering processMethods0.000description1
- 238000002474experimental methodMethods0.000description1
- 239000000835fiberSubstances0.000description1
- 238000012986modificationMethods0.000description1
- 230000004048modificationEffects0.000description1
- 230000000750progressive effectEffects0.000description1
- 238000006467substitution reactionMethods0.000description1
- 238000005406washingMethods0.000description1
Images
Classifications
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B23/00—Testing or monitoring of control systems or parts thereof
- G05B23/02—Electric testing or monitoring
- G05B23/0205—Electric testing or monitoring by means of a monitoring system capable of detecting and responding to faults
- G05B23/0218—Electric testing or monitoring by means of a monitoring system capable of detecting and responding to faults characterised by the fault detection method dealing with either existing or incipient faults
- G05B23/0256—Electric testing or monitoring by means of a monitoring system capable of detecting and responding to faults characterised by the fault detection method dealing with either existing or incipient faults injecting test signals and analyzing monitored process response, e.g. injecting the test signal while interrupting the normal operation of the monitored system; superimposing the test signal onto a control signal during normal operation of the monitored system
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/20—Pc systems
- G05B2219/24—Pc safety
- G05B2219/24065—Real time diagnostics
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Automation & Control Theory (AREA)
- Computer And Data Communications (AREA)
Abstract
Description
Technical Field
One or more embodiments of the invention relate to an electronic information technology, and in particular, to a performance test method and system for smart home equipment.
Background
With the increasing popularization of the smart home devices, the attention of users is concerned about the good and bad use of the smart home devices except that the smart home devices cannot be used. The usability of the intelligent household equipment directly influences the use experience of the user on the intelligent household equipment. The performance of the smart home device is particularly important for the smart home device.
At present, an effective mode is not provided for testing the performance of the intelligent household equipment.
Disclosure of Invention
One or more embodiments of the invention describe a performance testing method and system for smart home devices, which can more effectively test the performance of the smart home devices.
According to a first aspect, a method for testing performance of smart home devices, the method comprising:
analyzing communication link equipment from the intelligent household equipment to the server to generate a network topological graph corresponding to the intelligent household equipment;
generating a first service operation instruction, and sending the first service operation instruction to a server according to the network topological graph;
acquiring the operation time aiming at the first service operation instruction in a packet capturing and log printing mode;
testing the controllability of the intelligent household equipment according to the acquired operation time and the network topological graph;
and obtaining the disconnection condition of the intelligent household equipment under the first control condition, and testing the connection stability of the intelligent household equipment according to the disconnection condition.
Generating a first service operation instruction by control equipment of the intelligent household equipment;
the obtaining of the operation time for the first service operation instruction includes:
acquiring time-consuming T0 from the control device receiving a first business operation instruction to the control device sending the first business operation instruction to the server in a log printing mode;
acquiring a time point t1 when the control device sends a first service operation instruction to the server in a packet capturing mode;
acquiring time-consuming T2 from a first service operation instruction received by a server from a control device to the time when the server sends a second service operation instruction to the intelligent household device in a log printing mode;
acquiring a time point t3 when the server sends a second service operation instruction to the intelligent household equipment in a packet capturing mode;
acquiring time-consuming T4 from the receiving of the second service operation instruction to the sending of the instruction to the internal electric control component by the intelligent household equipment in a log printing mode;
acquiring a time point t5 when the intelligent household equipment sends an instruction to an internal electric control component in a log printing mode;
acquiring a time point t6 when the intelligent household equipment receives data sent by an internal electric control component in a log printing mode;
acquiring time-consuming T7 from the time when the intelligent home equipment receives the second service operation instruction to the time when the intelligent home equipment sends response data to the server in a log printing mode;
acquiring a time point t8 when the smart home equipment starts to send the response data to the server in a packet capturing mode;
acquiring time-consuming T9 from the time when the server receives the response data until the server sends a response message aiming at the first business operation instruction to the control equipment in a log printing mode;
acquiring a time point t10 when the server starts to send the response message to the control equipment in a packet capturing mode;
acquiring time-consuming T11 from the reception of a response message to the completion of the processing by the control device in a log printing mode;
and calculating the total consumed time T, namely T0+ (T3-T1) + T4+ (T6-T5) + T7+ (T10-T8) + T11, and taking T as the operation time of the first business operation instruction.
The control apparatus includes: the mobile terminal is loaded with an APP for controlling the intelligent household equipment; the testing the controllability of the smart home device according to the obtained operation time and the network topology includes: obtaining the number and the performance of transfer equipment according to a network topological graph corresponding to the intelligent home equipment, and determining the controllability of the APP for controlling the intelligent home equipment according to the number and the performance of the transfer equipment and the total consumed time T;
and/or the presence of a gas in the gas,
the control apparatus includes: a remote controller of the smart home device; the testing the controllability of the smart home device according to the obtained operation time and the network topology includes: and obtaining the number and the performance of the transfer equipment according to the network topological graph corresponding to the intelligent household equipment, and determining the controllability of the remote controller of the intelligent household equipment according to the number and the performance of the transfer equipment and the total consumed time T.
The acquiring of the connection stability of the intelligent household equipment under the first control condition according to the disconnection condition, includes:
controlling the intelligent household equipment to be in a standby state, keeping the standby state within a preset first time period, and monitoring whether the intelligent household equipment is disconnected to obtain a group of disconnected statistical data; repeatedly executing the steps until the statistical data of the set groups are obtained, and determining the connection stability of the intelligent household equipment according to the statistical data of the set groups;
and/or the presence of a gas in the gas,
controlling the intelligent household appliance to continuously run for a preset second time length by using an automatic tool, and monitoring whether the intelligent household appliance is disconnected to obtain a group of disconnected statistical data; and repeating the execution until the statistical data of the set groups are obtained, and determining the connection stability of the intelligent household equipment according to the statistical data of the set groups.
The method further comprises the following steps:
when the intelligent household equipment is in a normal network connection state, disconnecting the network connection of the intelligent household equipment, resuming the network after the intelligent household equipment is off-line, and waiting for the intelligent household equipment to be on-line; recording the time from offline to online of the intelligent household equipment in a log printing mode, and testing the time difference of recovery control after the intelligent household equipment is disconnected according to the recorded time;
and/or the presence of a gas in the gas,
the instructions are sequentially sent through high frequency, and the timestamps of the sending and receiving instructions of the server end and the intelligent household equipment end in each group are printed in a log printing mode, so that the accuracy of MQTT multi-message sending of the intelligent household equipment is tested.
The method further comprises the following steps:
subjective attractiveness is evaluated through control APPs of a plurality of different intelligent household devices, and a plurality of user samples are counted;
and/or the presence of a gas in the gas,
operating an intelligent household device APP and controlling the intelligent household device in a task flow mode on a plurality of user samples, and taking a comprehensive conclusion of the plurality of user samples as an evaluation result;
and/or the presence of a gas in the gas,
the subjective evaluation on the intelligent household equipment is obtained according to the effective degree of the text guidance of the undefined function in the process of operating the intelligent household equipment APP by the user.
According to a second aspect, a performance test system of smart home devices is provided, including: the system comprises a server, control equipment of intelligent household equipment, the intelligent household equipment and a time information acquisition module; wherein,
the server is used for analyzing communication link equipment from the intelligent household equipment to the server and generating a network topological graph corresponding to the intelligent household equipment; testing the controllability of the intelligent household equipment according to the acquired operation time and the network topological graph; and obtaining the disconnection condition of the intelligent household equipment under the first control condition, and testing the connection stability of the intelligent household equipment according to the disconnection condition.
The control equipment of the intelligent home equipment is used for generating a first business operation instruction and sending the first business operation instruction to the server according to the network topological graph;
and the time information acquisition module is used for acquiring the operation time aiming at the first service operation instruction in a packet capturing and log printing mode.
The time information acquisition module includes: a first time information acquisition submodule in the server, a second time information acquisition submodule in the control equipment, and a third time information acquisition submodule in the intelligent home equipment; wherein,
the second time information obtaining submodule is used for obtaining time-consuming T0 from the control equipment receiving the first service operation instruction to the control equipment sending the first service operation instruction to the server in a log printing mode; acquiring a time point t1 when the control device sends a first service operation instruction to the server in a packet capturing mode; acquiring time-consuming T11 from the reception of a response message to the completion of the processing by the control device in a log printing mode;
the first time information acquisition submodule is used for acquiring time-consuming T2 from a first service operation instruction received by the server from the control equipment to the time when the server sends a second service operation instruction to the intelligent household equipment in a log printing mode; acquiring a time point t3 when the server sends a second service operation instruction to the intelligent household equipment in a packet capturing mode; acquiring time-consuming T9 from the time when the server receives the response data until the server sends a response message aiming at the first business operation instruction to the control equipment in a log printing mode; acquiring a time point t10 when the server starts to send the response message to the control equipment in a packet capturing mode; and calculating the total consumed time T as T0+ (T3-T1) + T4+ (T6-T5) + T7+ (T10-T8) + T11 according to the processing results of the second time information acquisition submodule and the third time information acquisition submodule, and taking T as the operation time of the first service operation instruction.
The third time information obtaining submodule is used for obtaining time-consuming T4 from the time when the intelligent household equipment receives the second service operation instruction to the time when the intelligent household equipment sends the instruction to the internal electric control component in a log printing mode; acquiring a time point t5 when the intelligent household equipment sends an instruction to an internal electric control component in a log printing mode; acquiring a time point t6 when the intelligent household equipment receives data sent by an internal electric control component in a log printing mode; acquiring time-consuming T7 from the time when the intelligent home equipment receives the second service operation instruction to the time when the intelligent home equipment sends response data to the server in a log printing mode; and acquiring a time point t8 when the smart home device starts to send the response data to the server in a packet capturing mode.
The control apparatus includes: the mobile terminal is loaded with an APP for controlling the intelligent household equipment; the server is configured to obtain the number and performance of the relay devices according to the network topology map corresponding to the smart home device, and determine controllability of the APP controlling the smart home device according to the number and performance of the relay devices and the total consumed time T;
and/or the presence of a gas in the gas,
the control apparatus includes: a remote controller of the smart home device; the server is configured to obtain the number and performance of the relay devices according to the network topology map corresponding to the smart home device, and determine the controllability of the remote controller of the smart home device according to the number and performance of the relay devices and the total consumed time T;
and/or the presence of a gas in the gas,
the server is used for controlling the intelligent household equipment to be in a standby state, keeping the standby state within a preset first time period, monitoring whether the intelligent household equipment is disconnected or not, and obtaining a group of disconnected statistical data; repeatedly executing the steps until the statistical data of the set groups are obtained, and determining the connection stability of the intelligent household equipment according to the statistical data of the set groups;
and/or the presence of a gas in the gas,
the server is used for controlling the intelligent household appliance to continuously run for a preset second time length by using an automatic tool, monitoring whether the intelligent household appliance is disconnected or not, and obtaining a group of disconnected statistical data; and repeating the execution until the statistical data of the set groups are obtained, and determining the connection stability of the intelligent household equipment according to the statistical data of the set groups.
According to a third aspect, there is provided a computing device comprising a memory and a processor, wherein the memory stores executable code, and the processor executes the executable code to implement the method according to any of the embodiments of the present invention.
According to the performance testing method and system for the intelligent home equipment, provided by the embodiment of the invention, the controllability of the intelligent home equipment can be tested according to the network topological graph from the intelligent home equipment to the server at the cloud end and by combining the operation time of the first service operation instruction; meanwhile, the connection stability of the intelligent household equipment can be tested according to the line drop rate under the first control condition, so that the comprehensive capability of the intelligent household appliance in the aspects of controllability and connection stability can be effectively tested, and the service requirements are met.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a schematic diagram of a service scenario to which an embodiment of the present invention is applied.
Fig. 2 is a flowchart of a performance testing method of smart home devices in an embodiment of the present invention.
Fig. 3 is a flowchart of obtaining the operation time for the first service operation instruction by means of packet capture and log printing in an embodiment of the present invention.
Fig. 4 is a schematic structural diagram of a performance testing system of smart home devices in an embodiment of the present invention.
Detailed Description
The scheme provided by the embodiment of the invention is described below with reference to the accompanying drawings.
To facilitate understanding of the present specification, a system architecture to which the present specification applies will be described first. As shown in fig. 1, the system architecture mainly includes an intelligent home device, a control device of the intelligent home device, and a server in the cloud. The intelligent home equipment can be intelligent equipment such as an intelligent refrigerator, an intelligent washing machine, an intelligent television and an intelligent curtain, the server at the cloud end is responsible for processing various information of the intelligent home equipment, and the control equipment of the intelligent home equipment can be a mobile terminal loaded with an APP for controlling the intelligent home equipment, a remote controller of the intelligent home equipment and the like. The intelligent home equipment, the control equipment and the cloud server are interacted through a network. The network may include various connection types, such as wired, wireless communication links, or fiber optic cables, among others.
Fig. 2 is a flowchart of a performance testing method of smart home devices in an embodiment of the present invention. It is to be appreciated that the method can be performed by any apparatus, device, platform, cluster of devices having computing and processing capabilities. Referring to fig. 2, the method includes:
step 201: and analyzing communication link equipment from the intelligent household equipment to the server to generate a network topological graph corresponding to the intelligent household equipment.
Step 203: and generating a first service operation instruction, and sending the first service operation instruction to a server according to the network topological graph.
Step 205: and acquiring the operation time aiming at the first service operation instruction in a packet capturing and log printing mode.
Step 207: and testing the controllability of the intelligent household equipment according to the acquired operation time and the network topological graph.
Step 209: and obtaining the disconnection condition of the intelligent household equipment under the first control condition, and testing the connection stability of the intelligent household equipment according to the disconnection condition.
As can be seen from the flow shown in fig. 2, in the embodiment of the present invention, the controllability of the smart home device can be tested according to the network topology from the smart home device to the server in the cloud in combination with the operation time of the first service operation instruction; meanwhile, the connection stability of the intelligent household equipment can be tested according to the line drop rate under the first control condition, so that the comprehensive capability of the intelligent household appliance in the aspects of controllability and connection stability can be effectively tested, and the service requirements are met.
The following is a description of each step in fig. 2.
First, instep 201, a communication link device from an intelligent home device to a server is analyzed, and a network topology corresponding to the intelligent home device is generated.
In actual business implementation, different intelligent home devices are different in communication link to the server, some intelligent home devices need to be connected to the server at the high in the clouds through a large number of multi-stage transfer devices, some intelligent home devices only need to be connected to the server at the high in the clouds through few transfer devices, the amount of the transfer devices, the link connection mode and the like can influence the communication time between the intelligent home devices and the server, and the network topology map needs to be considered when the performance of the intelligent home devices is tested.
Next, instep 203, a first service operation instruction is generated, and the first service operation instruction is sent to the server according to the network topology.
Here, the first service operation instruction may be generated by the control device of the smart home device, so as to test the time required for completing one interaction among the control device, the smart home device, and the server.
Next, instep 205, the operation time for the first service operation instruction is obtained by means of packet capturing and log printing.
In the embodiment of the invention, in order to complete the test, various time points are obtained in a packet capturing and log printing mode innovatively, and the time required by one-time interaction among the control equipment, the intelligent household equipment and the server can be tested according to the obtained various time points.
In an embodiment of the present invention, referring to fig. 3, the process ofstep 205 may specifically include the following steps:
step 301: acquiring time-consuming T0 from the control device receiving a first business operation instruction to the control device sending the first business operation instruction to the server in a log printing mode;
step 303: acquiring a time point t1 when the control device sends a first service operation instruction to the server in a packet capturing mode;
step 305: acquiring time-consuming T2 from a first service operation instruction received by a server from a control device to the time when the server sends a second service operation instruction to the intelligent household device in a log printing mode;
step 307: acquiring a time point t3 when the server sends a second service operation instruction to the intelligent household equipment in a packet capturing mode;
step 309: acquiring time-consuming T4 from the receiving of the second service operation instruction to the sending of the instruction to the internal electric control component by the intelligent household equipment in a log printing mode;
step 311: acquiring a time point t5 when the intelligent household equipment sends an instruction to an internal electric control component in a log printing mode;
step 313: acquiring a time point t6 when the intelligent household equipment receives data sent by an internal electric control component in a log printing mode;
step 315: acquiring time-consuming T7 from the time when the intelligent home equipment receives the second service operation instruction to the time when the intelligent home equipment sends response data to the server in a log printing mode;
step 317: acquiring a time point t8 when the smart home equipment starts to send the response data to the server in a packet capturing mode;
step 319: acquiring time-consuming T9 from the time when the server receives the response data until the server sends a response message aiming at the first business operation instruction to the control equipment in a log printing mode;
step 321: acquiring a time point t10 when the server starts to send the response message to the control equipment in a packet capturing mode;
step 323: acquiring time-consuming T11 from the reception of a response message to the completion of the processing by the control device in a log printing mode;
step 325: and calculating the total consumed time T, namely T0+ (T3-T1) + T4+ (T6-T5) + T7+ (T10-T8) + T11, and taking T as the operation time of the first business operation instruction.
It can be seen from the process shown in fig. 3 that, according to the characteristics of the service, various time points and time-consuming durations are obtained by adopting a packet capturing or log printing mode, so that the time required for completing one-time interaction among the control device, the smart home device and the server can be calculated through the recorded various time points and durations. The packet capturing or log printing mode accurately records the time point of the operation and the duration of the operation, so that the operation time for the first service operation instruction can be calculated more accurately.
Next, instep 207, the controllability of the smart home device is tested according to the obtained operation time and the network topology.
In the embodiment of the present invention, the control device of the smart home device may be a mobile terminal loaded with an APP for controlling the smart home device. Then, in thisstep 207, the number and performance of the relay devices are obtained according to the network topology corresponding to the smart home device, and the controllability of the APP controlling the smart home device is determined according to the number and performance of the relay devices and the total consumed time T.
In the embodiment of the present invention, the control device of the smart home device may be a remote controller of the smart home device. Then, instep 207, the number and performance of the relay devices are obtained according to the network topology corresponding to the smart home device, and the controllability of the remote controller of the smart home device is determined according to the number and performance of the relay devices and the total consumed time T.
And at this moment, according to a network topological graph, a log printing mode and a packet capturing mode, combining time corresponding to each operation, and comprehensively obtaining controllability of the intelligent home equipment under operation control of control equipment such as an APP and a remote controller.
Next, instep 209, a connection drop condition of the smart home device under the first control condition is obtained, and connection stability of the smart home device is tested according to the connection drop condition.
Under the condition of obtaining the controllability, the connection stability of the intelligent household equipment can be further tested under the condition of disconnection, and therefore the intelligent household equipment can be tested from multiple dimensions.
In an embodiment of the present invention, in thisstep 209, the testing of the disconnection rate of the smart home device when the smart home device is continuously in standby for setting may specifically include: controlling the intelligent household equipment to be in a standby state, keeping the standby state within a preset first time period, such as 12 hours continuously, monitoring whether the intelligent household equipment is disconnected or not, and obtaining a group of disconnected statistical data; and repeating the execution until a set group number, such as 5 groups of statistical data, is obtained, and determining the connection stability of the intelligent household equipment according to the statistical data of the set group number.
In an embodiment of the present invention, in thisstep 209, a drop-off rate of the smart home device when the smart home device is continuously operated (not stopped, not in standby) and set for a long time may be tested, which specifically includes: controlling the intelligent household appliance to continuously run for a preset second time period, such as 12 hours, by using an automatic tool, and monitoring whether the intelligent household appliance is disconnected to obtain a group of disconnected statistical data; and repeating the execution until a set group number, such as 5 groups of statistical data, is obtained, and determining the connection stability of the intelligent household equipment according to the statistical data of the set group number.
In the method of the embodiment of the present invention, the following tests may be further performed:
objective test 1:
when the intelligent household equipment is in a normal network connection state, disconnecting the network connection of the intelligent household equipment, resuming the network after the intelligent household equipment is off-line, and waiting for the intelligent household equipment to be on-line; the time difference of the recovery control of the intelligent household equipment after the network is disconnected is tested according to the recorded time.
Objective test 2:
the instructions are sequentially sent through high frequency, and the timestamps of the sending and receiving instructions of the server end and the intelligent household equipment end in each group are printed in a log printing mode, so that the accuracy of MQTT multi-message sending of the intelligent household equipment is tested. For example, the APP is adjusted to achieve that the high frequency sequentially sends the instruction for 250 times, the frequency is 5-10 times/second, the APP end and the equipment end in each group of experiment are printed in a log printing mode, the timestamp of the sending and receiving instruction is counted for five groups of data, and comprehensive evaluation is performed through the five groups of data.
In the above embodiments, the process of objective evaluation is described through the obtained objective test data of the smart home device.
In actual business, in order to test the smart home devices from more dimensions, subjective evaluation may be performed, for example, in the method of the embodiment of the present invention, the following test may be further performed:
subjective test 1:
subjective aesthetic measure is evaluated through control APP of a plurality of different intelligent household devices to a plurality of user samples are counted.
Subjective test 2:
the method comprises the steps of operating an intelligent household device APP through a plurality of user samples in a task flow mode and controlling the intelligent household device APP, and taking a comprehensive conclusion of the plurality of user samples as an evaluation result.
Subjective test 3:
the subjective evaluation on the intelligent household equipment is obtained according to the effective degree of the text guidance of the undefined function in the process of operating the intelligent household equipment APP by the user.
In an embodiment of the present invention, a performance testing system of smart home devices is further provided, referring to fig. 4, the system includes: the system comprises aserver 401, control equipment 402 of intelligent household equipment,intelligent household equipment 403 and a timeinformation acquisition module 404; wherein,
theserver 401 is configured to analyze communication link devices from thesmart home devices 403 to theserver 401, and generate a network topology map corresponding to thesmart home devices 403; testing the controllability of thesmart home device 403 according to the obtained operation time and the network topology; obtaining a disconnection condition of theintelligent household equipment 403 under a first control condition, and testing the connection stability of theintelligent household equipment 403 according to the disconnection condition.
The control device 402 of the smart home device is configured to generate a first service operation instruction, and send the first service operation instruction to theserver 401 according to the network topology;
and a timeinformation obtaining module 404, configured to obtain, by packet capturing and log printing, the operation time for the first service operation instruction.
In an embodiment of the system of the present invention, the timeinformation obtaining module 404 includes: a first time information obtaining submodule located in theserver 401, a second time information obtaining submodule located in the control device 402, and a third time information obtaining submodule located in thesmart home device 403; wherein,
the second time information obtaining submodule is configured to obtain, in a log printing manner, a consumed time T0 when the control device 402 receives the first service operation instruction and the control device 402 sends the first service operation instruction to theserver 401; acquiring a time point t1 when the control device 402 sends a first service operation instruction to theserver 401 in a packet capturing manner; acquiring the time consumed T11 from the reception of the response message to the completion of the processing by the control device 402 in a log printing manner;
the first time information obtaining submodule is configured to obtain, in a log printing manner, a time-consuming T2 from when theserver 401 receives the first service operation instruction of the control device 402 until theserver 401 sends the second service operation instruction to thesmart home device 403; acquiring a time point t3 when theserver 401 sends a second service operation instruction to thesmart home device 403 in a packet capturing manner; acquiring time-consuming T9 from the time when theserver 401 receives the response data until theserver 401 sends a response message for the first service operation instruction to the control device in a log printing mode; acquiring a time point t10 when theserver 401 starts to send the response message to the control device 402 in a packet capturing manner; and calculating the total consumed time T as T0+ (T3-T1) + T4+ (T6-T5) + T7+ (T10-T8) + T11 according to the processing results of the second time information acquisition submodule and the third time information acquisition submodule, and taking T as the operation time of the first service operation instruction.
The third time information obtaining submodule is configured to obtain, in a log printing manner, a time-consuming T4 from when thesmart home device 403 receives the second service operation instruction to when the smart home device sends an instruction to the internal electronic control component; acquiring a time point t5 when theintelligent household equipment 403 sends an instruction to an internal electric control component in a log printing mode; acquiring a time point t6 when theintelligent household equipment 403 receives data sent by an internal electronic control component in a log printing mode; acquiring time-consuming T7 from the time when thesmart home device 403 receives the second service operation instruction until thesmart home device 403 sends response data to theserver 401 by means of log printing; and acquiring a time point t8 when thesmart home device 403 starts to send the response data to theserver 401 in a packet capturing manner.
In one embodiment of the system of the present invention, the control device 402 comprises: the mobile terminal is loaded with an APP for controlling the intelligent household equipment; theserver 401 is configured to obtain the number and performance of the relay devices according to the network topology map corresponding to the smart home device, and determine the controllability of the APP controlling thesmart home device 403 according to the number and performance of the relay devices and the total consumed time T;
in one embodiment of the system of the present invention, the control device 402 comprises: a remote controller of the smart home device; theserver 401 is configured to obtain the number and performance of the relay devices according to the network topology map corresponding to thesmart home device 403, and determine the controllability of the remote controller of thesmart home device 403 according to the number and performance of the relay devices and the total consumed time T.
In an embodiment of the system of the present invention, theserver 401 is configured to control thesmart home device 403 to be in a standby state, and maintain the standby state within a preset first time period, and monitor whether the smart home device is disconnected, so as to obtain a group of offline statistical data; and repeating the execution until the statistical data of the set group number is obtained, and determining the connection stability of thesmart home devices 403 according to the statistical data of the set group number.
In an embodiment of the system of the present invention, theserver 401 is configured to use an automation tool to control the intelligent householdelectrical appliance 403 to continuously run for a preset second duration, and monitor whether the intelligent household electrical appliance is disconnected, so as to obtain a set of disconnected statistical data; and repeating the execution until the statistical data of the set group number is obtained, and determining the connection stability of thesmart home devices 403 according to the statistical data of the set group number.
An embodiment of the present invention provides a computing device, including a memory and a processor, where the memory stores executable codes, and the processor executes the executable codes to implement a method in any embodiment of the specification.
It is to be understood that the illustrated construction of the embodiments of the invention is not to be construed as a specific limitation on the apparatus of the embodiments of the invention. In other embodiments of the description, the apparatus may include more or fewer components than illustrated, or some components may be combined, some components may be separated, or a different arrangement of components may be used. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
Because the contents of information interaction, execution process, and the like between the modules in the above-mentioned apparatus and system are based on the same concept as the method embodiment of the present invention, specific contents may refer to the description in the method embodiment of the present invention, and are not described herein again.
The embodiments of the present invention are all described in a progressive manner, and the same and similar parts among the embodiments can be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, as for the apparatus embodiment, since it is substantially similar to the method embodiment, the description is relatively simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
Those skilled in the art will recognize that, in one or more of the examples described above, the functions described in this disclosure may be implemented in hardware, software, hardware, or any combination thereof. When implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium.
The above-mentioned embodiments, objects, technical solutions and advantages of the present invention are further described in detail, it should be understood that the above-mentioned embodiments are only exemplary embodiments of the present invention, and are not intended to limit the scope of the present invention, and any modifications, equivalent substitutions, improvements and the like made on the basis of the technical solutions of the present invention should be included in the scope of the present invention.
Claims (10)
1. The performance test method of the intelligent household equipment is characterized by comprising the following steps:
analyzing communication link equipment from the intelligent household equipment to the server to generate a network topological graph corresponding to the intelligent household equipment;
generating a first service operation instruction, and sending the first service operation instruction to a server according to the network topological graph;
acquiring the operation time aiming at the first service operation instruction in a packet capturing and log printing mode;
testing the controllability of the intelligent household equipment according to the acquired operation time and the network topological graph;
and obtaining the disconnection condition of the intelligent household equipment under the first control condition, and testing the connection stability of the intelligent household equipment according to the disconnection condition.
2. The method according to claim 1, wherein a first business operation instruction is generated by a control device of the smart home device;
the obtaining of the operation time for the first service operation instruction includes:
acquiring time-consuming T0 from the control device receiving a first business operation instruction to the control device sending the first business operation instruction to the server in a log printing mode;
acquiring a time point t1 when the control device sends a first service operation instruction to the server in a packet capturing mode;
acquiring time-consuming T2 from a first service operation instruction received by a server from a control device to the time when the server sends a second service operation instruction to the intelligent household device in a log printing mode;
acquiring a time point t3 when the server sends a second service operation instruction to the intelligent household equipment in a packet capturing mode;
acquiring time-consuming T4 from the receiving of the second service operation instruction to the sending of the instruction to the internal electric control component by the intelligent household equipment in a log printing mode;
acquiring a time point t5 when the intelligent household equipment sends an instruction to an internal electric control component in a log printing mode;
acquiring a time point t6 when the intelligent household equipment receives data sent by an internal electric control component in a log printing mode;
acquiring time-consuming T7 from the time when the intelligent home equipment receives the second service operation instruction to the time when the intelligent home equipment sends response data to the server in a log printing mode;
acquiring a time point t8 when the smart home equipment starts to send the response data to the server in a packet capturing mode;
acquiring time-consuming T9 from the time when the server receives the response data until the server sends a response message aiming at the first business operation instruction to the control equipment in a log printing mode;
acquiring a time point t10 when the server starts to send the response message to the control equipment in a packet capturing mode;
acquiring time-consuming T11 from the reception of a response message to the completion of the processing by the control device in a log printing mode;
and calculating the total consumed time T, namely T0+ (T3-T1) + T4+ (T6-T5) + T7+ (T10-T8) + T11, and taking T as the operation time of the first business operation instruction.
3. The method of claim 2,
the control apparatus includes: the mobile terminal is loaded with an APP for controlling the intelligent household equipment; the testing the controllability of the smart home device according to the obtained operation time and the network topology includes: obtaining the number and the performance of transfer equipment according to a network topological graph corresponding to the intelligent home equipment, and determining the controllability of the APP for controlling the intelligent home equipment according to the number and the performance of the transfer equipment and the total consumed time T;
and/or the presence of a gas in the gas,
the control apparatus includes: a remote controller of the smart home device; the testing the controllability of the smart home device according to the obtained operation time and the network topology includes: and obtaining the number and the performance of the transfer equipment according to the network topological graph corresponding to the intelligent household equipment, and determining the controllability of the remote controller of the intelligent household equipment according to the number and the performance of the transfer equipment and the total consumed time T.
4. The method according to claim 2, wherein the obtaining of the connection failure condition of the smart home device under the first control condition and testing the connection stability of the smart home device according to the connection failure condition comprise:
controlling the intelligent household equipment to be in a standby state, keeping the standby state within a preset first time period, and monitoring whether the intelligent household equipment is disconnected to obtain a group of disconnected statistical data; repeatedly executing the steps until the statistical data of the set groups are obtained, and determining the connection stability of the intelligent household equipment according to the statistical data of the set groups;
and/or the presence of a gas in the gas,
controlling the intelligent household appliance to continuously run for a preset second time length by using an automatic tool, and monitoring whether the intelligent household appliance is disconnected to obtain a group of disconnected statistical data; and repeating the execution until the statistical data of the set groups are obtained, and determining the connection stability of the intelligent household equipment according to the statistical data of the set groups.
5. The method of any one of claims 1 to 4, further comprising:
when the intelligent household equipment is in a normal network connection state, disconnecting the network connection of the intelligent household equipment, resuming the network after the intelligent household equipment is off-line, and waiting for the intelligent household equipment to be on-line; recording the time from offline to online of the intelligent household equipment in a log printing mode, and testing the time difference of recovery control after the intelligent household equipment is disconnected according to the recorded time;
and/or the presence of a gas in the gas,
the instructions are sequentially sent through high frequency, and the timestamps of the sending and receiving instructions of the server end and the intelligent household equipment end in each group are printed in a log printing mode, so that the accuracy of MQTT multi-message sending of the intelligent household equipment is tested.
6. The method of any one of claims 1 to 4, further comprising:
subjective attractiveness is evaluated through control APPs of a plurality of different intelligent household devices, and a plurality of user samples are counted;
and/or the presence of a gas in the gas,
operating an intelligent household device APP and controlling the intelligent household device in a task flow mode on a plurality of user samples, and taking a comprehensive conclusion of the plurality of user samples as an evaluation result;
and/or the presence of a gas in the gas,
the subjective evaluation on the intelligent household equipment is obtained according to the effective degree of the text guidance of the undefined function in the process of operating the intelligent household equipment APP by the user.
7. Intelligence household equipment's capability test system, its characterized in that includes: the system comprises a server, control equipment of intelligent household equipment, the intelligent household equipment and a time information acquisition module; wherein,
the server is used for analyzing communication link equipment from the intelligent household equipment to the server and generating a network topological graph corresponding to the intelligent household equipment; testing the controllability of the intelligent household equipment according to the acquired operation time and the network topological graph; obtaining a disconnection condition of the intelligent household equipment under a first control condition, and testing the connection stability of the intelligent household equipment according to the disconnection condition;
the control equipment of the intelligent home equipment is used for generating a first business operation instruction and sending the first business operation instruction to the server according to the network topological graph;
and the time information acquisition module is used for acquiring the operation time aiming at the first service operation instruction in a packet capturing and log printing mode.
8. The system of claim 7, wherein the time information obtaining module comprises: a first time information acquisition submodule in the server, a second time information acquisition submodule in the control equipment, and a third time information acquisition submodule in the intelligent home equipment; wherein,
the second time information obtaining submodule is used for obtaining time-consuming T0 from the control equipment receiving the first service operation instruction to the control equipment sending the first service operation instruction to the server in a log printing mode; acquiring a time point t1 when the control device sends a first service operation instruction to the server in a packet capturing mode; acquiring time-consuming T11 from the reception of a response message to the completion of the processing by the control device in a log printing mode;
the first time information acquisition submodule is used for acquiring time-consuming T2 from a first service operation instruction received by the server from the control equipment to the time when the server sends a second service operation instruction to the intelligent household equipment in a log printing mode; acquiring a time point t3 when the server sends a second service operation instruction to the intelligent household equipment in a packet capturing mode; acquiring time-consuming T9 from the time when the server receives the response data until the server sends a response message aiming at the first business operation instruction to the control equipment in a log printing mode; acquiring a time point t10 when the server starts to send the response message to the control equipment in a packet capturing mode; according to the processing results of the second time information acquisition submodule and the third time information acquisition submodule, calculating the total consumed time T as T0+ (T3-T1) + T4+ (T6-T5) + T7+ (T10-T8) + T11, and taking T as the operation time of the first service operation instruction;
the third time information obtaining submodule is used for obtaining time-consuming T4 from the time when the intelligent household equipment receives the second service operation instruction to the time when the intelligent household equipment sends the instruction to the internal electric control component in a log printing mode; acquiring a time point t5 when the intelligent household equipment sends an instruction to an internal electric control component in a log printing mode; acquiring a time point t6 when the intelligent household equipment receives data sent by an internal electric control component in a log printing mode; acquiring time-consuming T7 from the time when the intelligent home equipment receives the second service operation instruction to the time when the intelligent home equipment sends response data to the server in a log printing mode; and acquiring a time point t8 when the smart home device starts to send the response data to the server in a packet capturing mode.
9. The system of claim 7,
the control apparatus includes: the mobile terminal is loaded with an APP for controlling the intelligent household equipment; the server is configured to obtain the number and performance of the relay devices according to the network topology map corresponding to the smart home device, and determine controllability of the APP controlling the smart home device according to the number and performance of the relay devices and the total consumed time T;
and/or the presence of a gas in the gas,
the control apparatus includes: a remote controller of the smart home device; the server is configured to obtain the number and performance of the relay devices according to the network topology map corresponding to the smart home device, and determine the controllability of the remote controller of the smart home device according to the number and performance of the relay devices and the total consumed time T;
and/or the presence of a gas in the gas,
the server is used for controlling the intelligent household equipment to be in a standby state, keeping the standby state within a preset first time period, monitoring whether the intelligent household equipment is disconnected or not, and obtaining a group of disconnected statistical data; repeatedly executing the steps until the statistical data of the set groups are obtained, and determining the connection stability of the intelligent household equipment according to the statistical data of the set groups;
and/or the presence of a gas in the gas,
the server is used for controlling the intelligent household appliance to continuously run for a preset second time length by using an automatic tool, monitoring whether the intelligent household appliance is disconnected or not, and obtaining a group of disconnected statistical data; and repeating the execution until the statistical data of the set groups are obtained, and determining the connection stability of the intelligent household equipment according to the statistical data of the set groups.
10. A computing device comprising a memory having executable code stored therein and a processor that, when executing the executable code, implements the method of any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111054844.0ACN113741397B (en) | 2021-09-09 | 2021-09-09 | Performance test method and system for intelligent household equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111054844.0ACN113741397B (en) | 2021-09-09 | 2021-09-09 | Performance test method and system for intelligent household equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113741397Atrue CN113741397A (en) | 2021-12-03 |
| CN113741397B CN113741397B (en) | 2023-04-21 |
Family
ID=78737482
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111054844.0AActiveCN113741397B (en) | 2021-09-09 | 2021-09-09 | Performance test method and system for intelligent household equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113741397B (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103684937A (en)* | 2013-08-20 | 2014-03-26 | 上海理滋芯片设计有限公司 | A network topological structure in an intelligent household communication system and an establishment method thereof |
| CN106059849A (en)* | 2016-05-09 | 2016-10-26 | 上海斐讯数据通信技术有限公司 | Automatic trigger packet capture system and method |
| CN106850361A (en)* | 2017-01-13 | 2017-06-13 | 武汉亚讯环保科技有限公司 | A kind of apparatus and method for controlling intelligent home device |
| CN108737207A (en)* | 2017-04-25 | 2018-11-02 | 华为技术有限公司 | Propagation delay time detection method, equipment and system |
| CN109766256A (en)* | 2018-12-21 | 2019-05-17 | 中国平安财产保险股份有限公司 | H5 page performance test method, apparatus and computer equipment in application program |
| CN109933029A (en)* | 2019-03-11 | 2019-06-25 | 王祎凡 | A kind of intelligent home control system based on Cloud Server |
| CN110071847A (en)* | 2019-03-20 | 2019-07-30 | 深圳市飞比电子科技有限公司 | Message processing method, device, terminal device and storage medium |
| CN110380926A (en)* | 2019-07-01 | 2019-10-25 | 珠海格力电器股份有限公司 | Network automatic test method, terminal and computer readable medium of networking equipment |
| CN112333057A (en)* | 2020-08-21 | 2021-02-05 | 深圳Tcl新技术有限公司 | Intelligent household equipment distribution network testing method and device, execution machine and storage medium |
- 2021
- 2021-09-09CNCN202111054844.0Apatent/CN113741397B/enactiveActive
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103684937A (en)* | 2013-08-20 | 2014-03-26 | 上海理滋芯片设计有限公司 | A network topological structure in an intelligent household communication system and an establishment method thereof |
| CN106059849A (en)* | 2016-05-09 | 2016-10-26 | 上海斐讯数据通信技术有限公司 | Automatic trigger packet capture system and method |
| CN106850361A (en)* | 2017-01-13 | 2017-06-13 | 武汉亚讯环保科技有限公司 | A kind of apparatus and method for controlling intelligent home device |
| CN108737207A (en)* | 2017-04-25 | 2018-11-02 | 华为技术有限公司 | Propagation delay time detection method, equipment and system |
| CN109766256A (en)* | 2018-12-21 | 2019-05-17 | 中国平安财产保险股份有限公司 | H5 page performance test method, apparatus and computer equipment in application program |
| CN109933029A (en)* | 2019-03-11 | 2019-06-25 | 王祎凡 | A kind of intelligent home control system based on Cloud Server |
| CN110071847A (en)* | 2019-03-20 | 2019-07-30 | 深圳市飞比电子科技有限公司 | Message processing method, device, terminal device and storage medium |
| CN110380926A (en)* | 2019-07-01 | 2019-10-25 | 珠海格力电器股份有限公司 | Network automatic test method, terminal and computer readable medium of networking equipment |
| CN112333057A (en)* | 2020-08-21 | 2021-02-05 | 深圳Tcl新技术有限公司 | Intelligent household equipment distribution network testing method and device, execution machine and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113741397B (en) | 2023-04-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3386150B1 (en) | Terminal failure processing method, device and system | |
| CN108228444B (en) | Test method and device | |
| US20130322266A1 (en) | Network traffic monitoring | |
| CN110752954A (en) | Networking fault detection method and related device for household electrical appliance | |
| CN110501956B (en) | Production test alarm system, server and alarm information collection equipment | |
| CN112333044A (en) | Shunting equipment performance test method, device and system, electronic equipment and medium | |
| CN113542029A (en) | Service stability testing method, system and tool of network equipment | |
| CN106776323B (en) | Application testing method and device | |
| CN109962827B (en) | Equipment link detection method, device, equipment and readable storage medium | |
| CN115705190A (en) | Method and device for determining dependence degree | |
| CN112738922A (en) | Data processing method, device, storage medium and electronic device | |
| CN115794525A (en) | BMC (baseboard management controller) pressure testing method, device, equipment and storage medium | |
| CN113741397B (en) | Performance test method and system for intelligent household equipment | |
| CN106598793B (en) | A test system and test method based on BIOS serial port log data | |
| CN118964157A (en) | Server operation performance testing method and device | |
| CN105243015B (en) | Method and system for automatically testing software | |
| CN109587349B (en) | Multimedia agent line testing method and device, electronic equipment and storage medium | |
| CN109274533B (en) | Web service fault positioning device and method based on rule engine | |
| WO2016003501A1 (en) | Acquisition of high frequency data in transient detection | |
| US20190230538A1 (en) | Apparatus, system and method for testing of communication networks | |
| CN112312376A (en) | A method and system for remote interactive management of multi-function electricity meters | |
| CN106354626A (en) | Application test and method, system and device realizing application test in multiple terminals | |
| CN112564934B (en) | Fault positioning method and equipment for special line service circuit and computer storage medium | |
| CN115514681B (en) | Method, device, system, equipment and medium for testing equipment stability | |
| CN118413860A (en) | Intelligent device communication test method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |