CN114125071A - Data compression transmission method and device - Google Patents
Data compression transmission method and deviceDownload PDFInfo
- Publication number
- CN114125071A CN114125071ACN202111396502.7ACN202111396502ACN114125071ACN 114125071 ACN114125071 ACN 114125071ACN 202111396502 ACN202111396502 ACN 202111396502ACN 114125071 ACN114125071 ACN 114125071A
- Authority
- CN
- China
- Prior art keywords
- data message
- message
- data
- compression
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034methodMethods0.000titleclaimsabstractdescription62
- 230000005540biological transmissionEffects0.000titleclaimsabstractdescription51
- 238000013144data compressionMethods0.000titleclaimsabstractdescription29
- 238000007906compressionMethods0.000claimsabstractdescription248
- 230000006835compressionEffects0.000claimsabstractdescription247
- 238000004891communicationMethods0.000claimsabstractdescription107
- 238000012545processingMethods0.000claimsdescription24
- 230000006837decompressionEffects0.000claimsdescription19
- 238000004590computer programMethods0.000claimsdescription8
- 230000009467reductionEffects0.000abstractdescription2
- 230000008569processEffects0.000description10
- 238000012360testing methodMethods0.000description9
- 238000010586diagramMethods0.000description7
- 230000006870functionEffects0.000description5
- 230000004044responseEffects0.000description4
- 239000002699waste materialSubstances0.000description4
- 230000009471actionEffects0.000description3
- 230000003993interactionEffects0.000description3
- 238000013461designMethods0.000description2
- 230000000694effectsEffects0.000description2
- 238000005516engineering processMethods0.000description2
- 230000000903blocking effectEffects0.000description1
- 230000015556catabolic processEffects0.000description1
- 230000008859changeEffects0.000description1
- 238000006731degradation reactionMethods0.000description1
- 238000011161developmentMethods0.000description1
- 238000007667floatingMethods0.000description1
- PCHJSUWPFVWCPO-UHFFFAOYSA-NgoldChemical compound[Au]PCHJSUWPFVWCPO-UHFFFAOYSA-N0.000description1
- 239000010931goldSubstances0.000description1
- 229910052737goldInorganic materials0.000description1
- 238000012423maintenanceMethods0.000description1
- 238000012986modificationMethods0.000description1
- 230000004048modificationEffects0.000description1
- 238000012544monitoring processMethods0.000description1
- 230000003287optical effectEffects0.000description1
- 238000004088simulationMethods0.000description1
- 230000003068static effectEffects0.000description1
- 238000012795verificationMethods0.000description1
Images
Classifications
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/04—Protocols for data compression, e.g. ROHC
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/14—Session management
- H04L67/146—Markers for unambiguous identification of a particular session, e.g. session cookie or URL-encoding
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Information Transfer Between Computers (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
Description
Technical Field
The invention relates to the technical field of databases, in particular to a data compression transmission method and device.
Background
With the development of the internet and information age, data has penetrated all industries, and enterprises in the current society generate a huge amount of data to be stored and interacted, which brings a serious challenge to networks and information systems. When an information system application needs to query large data volume data through a network concurrently, a network blocking problem is easy to occur, and a Central Processing Unit (CPU) at a server side is idle and the network is busy.
In the existing scheme, one mode is to solve the above problems by increasing network bandwidth by an operator, but the mode has higher cost and increases the operation cost burden of enterprises; another way is to perform data manipulation with large traffic when the network is idle, but this way can only solve a small fraction of traffic problems.
Therefore, under the condition of limited network bandwidth, when a database server is concurrently queried to obtain a large amount of data, how to avoid the decrease of data transmission performance caused by network congestion is a problem that needs to be solved at present.
Disclosure of Invention
In order to solve the above technical problem or at least partially solve the above technical problem, the present invention provides a data compression transmission method and apparatus, which solve the problem of data transmission performance degradation caused by network congestion when a database server is concurrently queried to obtain large data volume data under the condition of limited network bandwidth.
In order to achieve the above object, the embodiments of the present invention provide the following technical solutions:
in a first aspect, an embodiment of the present invention provides a data compression transmission method, which is applied to a client, and the method includes:
sending a first message to a server, wherein the first message is used for requesting to establish connection with the server; the first packet includes: a communication compression control parameter and a compression threshold parameter;
if the communication compression control parameter is not zero and the data packet size of the first data message is larger than the value of the compression threshold parameter, compressing the first data message according to a preset compression algorithm to generate a second data message; the first data message is a message with a fixed format obtained by encoding request data sent by an application layer according to a preset communication protocol; the second data message is a compressed data message of the first data message and carries compression identification information;
and sending the second data message to the server.
As an optional implementation manner in this embodiment of the present invention, after sending the first packet to the server, the method further includes:
receiving a second message sent by the server, wherein the second message is used for indicating whether the connection between the client and the server is successful or not;
judging whether the connection between the client and the server is successfully established according to the second message;
if the connection is successful, compressing the first data message according to a preset compression algorithm when the communication compression control parameter is not zero and the size of the data packet of the first data message is larger than the value of the compression threshold parameter to generate a second data message.
As an optional implementation manner in this embodiment of the present invention, after sending the second data packet to the server, the method further includes:
receiving a fourth data message sent by the server; the fourth data message is a data message decompressed by the third data message and carries compression identification information; the third data message is a data message generated after the first data message is subjected to database basic operation;
decompressing the fourth data message according to a preset compression algorithm, and recovering to obtain a third data message;
and sending the third data message to an application layer.
As an optional implementation manner of the embodiment of the present invention, if the communication compression control parameter is zero, or the packet size of the first data packet is smaller than or equal to the value of the compression threshold parameter, the first data packet is sent to the server.
As an optional implementation manner of the embodiment of the present invention, a data compression transmission method is provided, which is applied to a server, and the method includes:
receiving a first message sent by a client, wherein the first message is used for requesting to establish connection with a server; the first packet includes: a communication compression control parameter and a compression threshold parameter;
analyzing the first message to obtain the communication compression control parameter and the compression threshold parameter;
receiving a second data message sent by the client; the second data message is a compressed data message of the first data message and carries compression identification information; the first data message is a message with a fixed format obtained by encoding request data sent by an application layer according to a preset communication protocol;
decompressing the second data message according to a preset compression algorithm, and recovering to obtain a first data message;
and processing the first data message according to the decompression result to generate a third data message, wherein the third data message is generated after the first data message is subjected to database basic operation.
As an optional implementation manner in this embodiment of the present invention, after receiving a first packet sent by a client, the method further includes:
and sending a second message to the client, wherein the second message is used for indicating whether the connection between the client and the server is successful.
As an optional implementation manner in this embodiment of the present invention, after processing the first data packet according to a decompression result and generating a third data packet, the method further includes:
if the communication compression control parameter is not zero and the size of the data packet of the first data message is larger than the value of the compression threshold parameter, decompressing the third data message according to a preset compression algorithm to generate a fourth data message; the fourth data message is a data message decompressed by the third data message and carries compression identification information;
and sending the fourth data message to the client.
In a second aspect, an embodiment of the present invention provides a client, including:
the starting module is used for sending a first message to the server, and the first message is used for requesting to establish connection with the server; the first packet includes: a communication compression control parameter and a compression threshold parameter;
the compression module is used for compressing the first data message according to a preset compression algorithm to generate a second data message if the communication compression control parameter is not zero and the size of the data packet of the first data message is larger than the value of the compression threshold parameter; the first data message is a message with a fixed format obtained by encoding request data sent by an application layer according to a preset communication protocol; the second data message is a compressed data message of the first data message and carries compression identification information;
and the sending module is used for sending the second data message to the server.
As an optional implementation manner of the embodiment of the present invention, the client further includes:
the receiving response module is used for receiving a second message sent by the server, wherein the second message is used for indicating whether the connection between the client and the server is successful or not;
the judging connection module is used for judging whether the connection between the client and the server is successfully established according to the second message; if the connection is successful, compressing the first data message according to a preset compression algorithm when the communication compression control parameter is not zero and the size of the data packet of the first data message is larger than the value of the compression threshold parameter to generate a second data message.
As an optional implementation manner of the embodiment of the present invention, the client further includes:
the message receiving module is used for receiving a fourth data message sent by the server; the fourth data message is a data message decompressed by the third data message and carries compression identification information; the third data message is a data message generated after the first data message is subjected to database basic operation;
the message decompression module is used for decompressing the fourth data message according to a preset compression algorithm and recovering to obtain a third data message;
and the message sending module is used for sending the third data message to an application layer.
As an optional implementation manner of the embodiment of the present invention, the client further includes:
and the parameter judgment module is used for sending the first data message to the server side if the communication compression control parameter is zero or the size of the data packet of the first data message is smaller than or equal to the value of the compression threshold parameter.
In a third aspect, an embodiment of the present invention provides a server, including:
the connection module is used for receiving a first message sent by a client, wherein the first message is used for requesting to establish connection with a server; the first packet includes: a communication compression control parameter and a compression threshold parameter;
the analysis module is used for analyzing the first message to obtain the communication compression control parameter and the compression threshold parameter;
the receiving module is used for receiving a second data message sent by the client; the second data message is a compressed data message of the first data message and carries compression identification information; the first data message is a message with a fixed format obtained by encoding request data sent by an application layer according to a preset communication protocol;
the decompression module is used for decompressing the second data message according to a preset compression algorithm and recovering to obtain a first data message;
and the processing module is used for processing the first data message according to the decompression result to generate a third data message, wherein the third data message is generated after the first data message is subjected to database basic operation.
As an optional implementation manner of the embodiment of the present invention, the server further includes:
and the response sending module is used for sending a second message to the client, wherein the second message is used for indicating whether the connection between the client and the server is successful.
As an optional implementation manner of the embodiment of the present invention, the server further includes:
the compression processing module is used for decompressing the third data message according to a preset compression algorithm to generate a fourth data message if the communication compression control parameter is not zero and the size of the data packet of the first data message is larger than the value of the compression threshold parameter; the fourth data message is a data message decompressed by the third data message and carries compression identification information;
and the result sending module is used for sending the fourth data message to the client.
In a fourth aspect, an embodiment of the present invention provides an electronic device, which includes a memory and a processor, where the memory stores a computer program, and the processor implements the data compression transmission method according to the first aspect or any implementation manner of the first aspect when executing the computer program.
The data compression transmission method provided by the embodiment of the invention is applied to a client, and comprises the steps of firstly sending a first message comprising a communication compression control parameter and a compression threshold parameter to a server, then determining whether to compress the first data message according to the communication compression control parameter and the compression threshold parameter, compressing the first data message according to a preset compression algorithm to generate a second data message, and sending the second data message to the server. Because the first message comprises a communication compression control parameter and a compression threshold parameter, and the first data message is a message with a fixed format obtained by encoding request data sent by an application layer according to a preset communication protocol, before the request message is transmitted, the problem of CPU resource waste caused by compression processing of small data packets can be avoided by judging the relation between the size of the data packet of the first data message and the compression threshold parameter, and whether the first data message is compressed or not and the size of the compression ratio can be determined through the specific numerical value of the communication compression control parameter, so that the data transmission quantity is reduced, the data transmission density is increased, and the data transmission performance under a network bottleneck is improved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without inventive exercise.
Fig. 1 is a schematic view of an application scenario of a data compression transmission method in an embodiment;
FIG. 2 is a schematic diagram illustrating an interaction flow between a client and a server in the data compression transmission method according to an embodiment;
FIG. 3 is a schematic diagram illustrating an interaction flow between a client and a server in another embodiment of a data compression transmission method;
FIG. 4 is a schematic diagram illustrating an embodiment of a data compression transmission method applied to a client;
FIG. 5 is a schematic structural diagram of a server to which the data compression transmission method is applied in one embodiment;
fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
In order that the above objects, features and advantages of the present invention may be more clearly understood, a solution of the present invention will be further described below. It should be noted that the embodiments of the present invention and features of the embodiments may be combined with each other without conflict.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present disclosure, but the present invention may be practiced in other ways than those described herein; it is to be understood that the embodiments described in this specification are only some embodiments of the invention, and not all embodiments.
Relational terms such as "first" and "second," and the like may be used throughout the description and claims of the present invention to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions.
In the embodiments of the present invention, the words "exemplary" or "for example" are used to mean serving as an example, instance, or illustration. Any embodiment or design described as "exemplary" or "e.g.," an embodiment of the present invention is not necessarily to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the word "exemplary" or "such as" is intended to present concepts related in a concrete fashion. Further, in the description of the embodiments of the present invention, "a plurality" means two or more unless otherwise specified.
The overall concept of the embodiment of the invention is as follows: under the condition of limited bandwidth, when a service layer needs to perform concurrent query on a database server to obtain a large number of large result sets, a first message comprising communication compression control parameters and compression threshold parameters is sent to a server, whether the first data message is compressed or not is determined according to the communication compression control parameters and the compression threshold parameters, the first data message is compressed according to a preset compression algorithm to generate a second data message, and finally the second data message is sent to the server, so that the problem of data transmission performance reduction caused by network congestion is solved.
Network congestion refers to a phenomenon that when the number of packets in a certain part of a communication subnet is too large, the part of the network is too short to process, so that the performance of the part or even the whole network is reduced.
The application provides a data compression transmission method which can be applied to the application environment shown in fig. 1. FIG. 1 is a diagram illustrating an exemplary implementation of a data compression transmission method; the application environment includes aclient 11 and aserver 12. The client and the server are in data communication through a network. Specifically, a client sends a first message to a server, wherein the first message is used for requesting to establish connection with the server; the first packet includes: a communication compression control parameter and a compression threshold parameter; if the communication compression control parameter is not zero and the data packet size of the first data message is larger than the value of the compression threshold parameter, compressing the first data message according to a preset compression algorithm to generate a second data message; the first data message is a message with a fixed format obtained by encoding request data sent by an application layer according to a preset communication protocol; the second data message is a compressed data message of the first data message and carries compression identification information; and sending the second data message to the server. The client may be, but not limited to, various tablet computers, notebook computers, and desktop computers, and the server may be implemented by an independent server or a server cluster formed by a plurality of servers.
Based on the application scenario shown in fig. 1, an embodiment of the present invention provides a data compression transmission method, which is shown in fig. 2. In this embodiment, the data compression transmission method includes the following steps:
and S21, sending the first message to the server.
The first message is used for requesting to establish connection with a server; the first packet includes: a communication compression control parameter and a compression threshold parameter.
Specifically, the first message may be understood as a start message, which has two functions, and first, the connection opening message when the client communicates with the database server. When a client side inquires data through a database server, user authority verification is required to be firstly carried out, and a database is connected after a user name and a password are verified. Secondly, communication compression control parameters and compression threshold parameters are designed and added in the format of the starting message. In addition, the first packet may further include: application name, protocol version number, time format, precision and type of floating point number, etc.
The communication compression control parameter represents the transmission compression level of the communication between the client and the server, and the value range of the communication compression control parameter can be any integer from 0 to 9. Specifically, 0 indicates turning off communication compression, 1 to 9 indicates turning on the level of compression, the larger the number is, the higher the compression level is, the smaller the amount of transmission data after compression is, the higher the corresponding CPU consumption is. The value of the compression threshold parameter may be set according to network conditions and data transmission scenarios, for example, the value of the compression threshold parameter may be set to 100M.
For example, in one application scenario, the client and the server communicate according to the front-end and back-end communication protocol of the greater funding corporation, that is, communicate in the form of protocol data packets. For example, the first packet may include: host name, host IP address, host port, operation user name, operation user password, database name, compression level, compression byte, etc., examples are as follows: "host ═ myhost ═ 10.11.12.13, port ═ 54388, user ═ wli, password ═ asdfg 123! @ #, dbname ═ kingbase, comm _ compress ═ 2, and cmss _ min _ size ═ 1kbyte ". In practical applications, the communication protocol formats used by the client and the server in different application scenarios may be agreed by themselves, and are not limited herein.
Correspondingly, the server receives a first message sent by the client.
It can be understood that, in the present embodiment, the KCI interface provided by the human cash box (providing a native efficient C access interface) is utilized to implement access to the database, and mainly provides operations of connecting, disconnecting, performing add-delete-modify-check and transaction opening, transaction rollback, transaction commit, and the like for the database. In addition, a database connection pool and a monitoring thread and a maintenance thread are provided, so that the access efficiency of the database is improved.
Specifically, after receiving the first message sent by the client, the server executes step S31.
S31, analyzing the first message, and acquiring the communication compression control parameter and the compression threshold parameter.
Specifically, the server obtains a communication compression control parameter and a compression threshold parameter by analyzing the first message.
And S22, if the communication compression control parameter is not zero and the size of the data packet of the first data message is larger than the value of the compression threshold parameter, compressing the first data message according to a preset compression algorithm to generate a second data message.
The first data message is a message of a fixed format obtained by encoding request data sent by an application layer according to a preset communication protocol.
For example, the data communication compression function of the big vault database needs to select a proper compression algorithm to perform the compression and decompression functions. The data compression algorithm mainly comprises a lossy compression algorithm and a lossless compression algorithm, and the basic requirements on data in the database are accuracy and integrity, so the requirements of the data communication compression of the big gold storehouse on the compression algorithm can be completely restored, namely, the lossless compression algorithm is required. Meanwhile, considering that the contents to be compressed during data communication compression of the database of the big financial house are mainly text data contents and require high compression rate and compression efficiency, the preset compression algorithm can select an LZ77 algorithm to complete compression and decompression tasks of the data contents of the communication messages between the client and the server. The LZ77 algorithm uses a virtual window that can slide along with the compression process as a dictionary of terms, and the string to be compressed, if it appears in the window, outputs its appearance position and length. The term matching is carried out by using a fixed-size window instead of matching in all the coded information, because the time consumption of a matching algorithm is often large, the size of a dictionary must be limited to ensure the efficiency of the algorithm; as the compression progresses, the dictionary window is made to always contain the most recently encoded information, since for most information, the strings to be encoded tend to find matching strings more easily in the most recent context.
In addition, it is understood that, in different data communication scenarios, a suitable compression and decompression algorithm may be selected according to requirements, which is merely an example and is not limited specifically.
And S23, sending the second data message to the server.
The second data packet is a compressed data packet of the first data packet and carries the compression identification information.
For example, for implementing the data communication compression function, the data packet structure of the communication protocol between the client and the server of the big vault database may be as shown in table 1.
TABLE 1
Specifically, the compressed identification information may be represented by a character 'M', and after the message is decompressed, if the compressed identification bit of the data is 'M', the message is represented as a compressed message; if the compression identifier of the data is other characters or numbers, the message is represented as an uncompressed message.
Correspondingly, the server receives a second data message sent by the client.
Specifically, after receiving the second data message sent by the client, the server executes step S32.
And S32, decompressing the second data message according to a preset compression algorithm, and recovering to obtain the first data message.
The second data packet is a compressed data packet of the first data packet and carries the compression identification information.
And S33, processing the first data message according to the decompression result to generate a third data message.
The third data message is a data message generated after the first data message is subjected to database basic operation.
Specifically, the basic operations of the database include: basic operations of the database, such as creating the database, checking all information of the database, modifying a database coding set and removing the database; basic operations of the table, such as creating the table, viewing table information, modifying field attributes, removing the table; basic operations on fields, adding fields, deleting fields, inserting fields, modifying fields, looking up fields, etc.
Illustratively, after the first data packet is analyzed, the function of obtaining the packet is to add a field, and then a field adding operation is executed in a database corresponding to the server side to obtain a third data packet, where data of the third data packet includes a newly added field.
The data compression transmission method provided by the embodiment of the invention is applied to a client, and comprises the steps of firstly sending a first message comprising a communication compression control parameter and a compression threshold parameter to a server, then determining whether to compress the first data message according to the communication compression control parameter and the compression threshold parameter, compressing the first data message according to a preset compression algorithm to generate a second data message, and sending the second data message to the server. Because the first message comprises the communication compression control parameter and the compression threshold parameter, and the first data message is a message with a fixed format obtained by encoding the request data sent by the application layer according to a preset communication protocol, before the request message is transmitted, the problem of CPU resource waste caused by compression processing of small data packets can be avoided by judging the relation between the value of the compression threshold parameter and the size of the data packet of the first data message, and whether the first data message is compressed or not and the size of the compression ratio can be determined by the specific value of the communication compression control parameter, so that the data transmission quantity is reduced, the data transmission density is increased, and the data transmission performance under the network bottleneck is improved.
In an embodiment, on the basis of fig. 2, a data compression transmission method provided in an embodiment of the present invention, as shown in fig. 3, includes the following steps:
and S21, sending the first message to the server.
The first message is used for requesting to establish connection with a server; the first packet includes: a communication compression control parameter and a compression threshold parameter.
Correspondingly, the server receives a first message sent by the client.
Specifically, after receiving the first message sent by the client, the server executes step S31.
S31, analyzing the first message, and acquiring the communication compression control parameter and the compression threshold parameter.
Specifically, the server receives a first message for requesting connection, analyzes the first message, and stores a communication compression control parameter and a compression threshold parameter, wherein the two compression parameters are used as a basis for data compression processing in a subsequent data interaction process.
Before step S31, step S301 of sending a second message to the client is further performed.
And the second message is used for indicating whether the connection between the client and the server is successful.
Specifically, whether the connection between the client and the server is successfully established or not is judged according to the second message.
If the connection is successful, step S22 is executed.
And S22, if the communication compression control parameter is not zero and the size of the data packet of the first data message is larger than the value of the compression threshold parameter, compressing the first data message according to a preset compression algorithm to generate a second data message.
The first data message is a message of a fixed format obtained by encoding request data sent by an application layer according to a preset communication protocol; and the second data message is the compressed data message of the first data message and carries the compression identification information.
Specifically, when the first packet sent by the client sets the value of the communication compression control parameter to be non-zero, it indicates that the client needs to establish a connection for compressing the transmission data, and before the subsequent message is sent, if the size of the packet is larger than the set value of the compression threshold parameter, then compression processing is adopted.
And S23, sending the second data message to the server.
Correspondingly, the server receives a second data message sent by the client.
Specifically, after receiving the second data message sent by the client, the server executes step S32.
And S32, decompressing the second data message according to a preset compression algorithm, and recovering to obtain the first data message.
Specifically, after the server receives a second data message, which is sent by the client and is compressed with respect to the first data message, the second data message carries the compression identification information, and the second data message is determined to be a compressed message according to the compression identification information, so that the second data message is decompressed and recovered to obtain the first data message.
And S33, processing the first data message according to the decompression result to generate a third data message, wherein the third data message is generated after the first data message is subjected to database basic operation.
And S34, if the communication compression control parameter is not zero and the size of the data packet of the first data message is larger than the value of the compression threshold parameter, decompressing the third data message according to a preset compression algorithm to generate a fourth data message.
And the fourth data message is a data message decompressed by the third data message and carries compression identification information.
And S35, sending the fourth data message to the client.
Correspondingly, the client receives the fourth data message sent by the server.
Specifically, after receiving the fourth data packet sent by the server, the client performs step S24.
And S24, decompressing the fourth data message according to a preset compression algorithm, and recovering to obtain a third data message.
And S25, sending the third data message to an application layer.
Specifically, after the client receives a fourth data packet, which is sent by the server and is compressed with respect to the third data packet, since the fourth data packet carries the compression identification information, it is determined according to the compression identification information that the fourth data packet is a compressed packet, so that the fourth data packet is decompressed, the third data packet is recovered, and then the third data packet is sent to the application layer.
Illustratively, when a large result set is transmitted by a client and a server through a network concurrently, when a CPU is idle and the bandwidth is insufficient, the transmission efficiency is improved by starting a communication compression mode, and the overall performance is improved by about 30%. The following test is performed by taking a multithread concurrent acquisition large result set test scenario of the simulation power POC as an example:
wherein, the test database environment is: 64-core central processing unit, x86+220G memory, and hundred megabits of bandwidth. The test data size is: test table 500 has rows and 6 columns, data type int (integer) or varchar (variable length string), and each row has a size of about 16 kbytes. The test case environment is: JDK1.8, multithread concurrent execution query obtains results. By testing the compression effect table, it can be known that: when the starting compression level is 2, the efficiency is improved to the highest degree, and the efficiency is improved to about 25% -30%.
In addition, it should be noted that in this embodiment, the test is to use the CPU to replace the network resource, and a high-performance physical machine is required to process compression and decompression, otherwise the test effect may be greatly different.
In the process of data communication between the client and the server, a communication layer compression method is adopted to compress communication messages, so that the data transmission quantity is reduced, and the data transmission density is increased, thereby improving the transmission performance under the network bottleneck.
In an embodiment, if the communication compression control parameter is zero, or the packet size of the first data packet is smaller than or equal to the value of the compression threshold parameter, the first data packet is sent to the server.
Specifically, when the first packet of the client sets the communication compression control parameter to zero, which indicates that communication compression is closed, only the original data packet sent by the application layer needs to be transmitted. Or, when the size of the data packet of the first data packet is smaller than or equal to the value of the compression threshold parameter, it indicates that the data volume of the transmitted data packet is small, and the problem of consuming excessive network bandwidth in the transmission process is not caused, so that compression is not needed, and at this time, the original data packet is also only needed to be sent to the server.
In this case, the server receives the first data packet, and the compressed identification information carried by the first data packet is a character or a number other than the character 'M', which indicates that the first data packet is an uncompressed packet.
Correspondingly, the server executes step S33, and processes the first data packet according to the decompression result to generate a third data packet, where the third data packet is generated after the database basic operation is performed on the first data packet.
Specifically, since the first data packet is an uncompressed packet, it is not necessary to decompress the first data packet, and the first data packet is directly processed according to the analysis result of the first data packet. The specific processing manner has been described in the above embodiments, and is not described herein again.
In one embodiment, if the communication compression control parameter is zero, or the packet size of the third data packet is smaller than or equal to the value of the compression threshold parameter, the third data packet is sent to the client.
Specifically, before sending the data packet to the client, the server first determines whether the communication compression control parameter is zero, and if the communication compression control parameter is zero, it indicates that communication compression is closed, and then transmits a third data packet. And then judging whether the size of the data packet of the third data message is smaller than or equal to the value of the compression threshold parameter, if so, indicating that the data volume of the transmitted data packet is very small and the problem of consuming excessive network bandwidth in the transmission process is not caused, so that compression is not needed, and at the moment, only the uncompressed third data message needs to be sent to the server.
Correspondingly, the client receives the third data message, and since the compressed identification information carried by the third data message is other characters or numbers except for the character 'M', which indicates that the third data message is an uncompressed message, the third data message does not need to be decompressed, and the third data message is directly sent to the application layer.
In the process of data communication between the client and the server, the problem of CPU resource waste caused by processing of small data packets can be effectively avoided by the method of judging the communication compression control parameter and the compression threshold parameter before the client sends data and judging the communication compression control parameter and the compression threshold parameter before the server sends data.
The data compression transmission method provided by the embodiment of the invention is applied to a client, and comprises the steps of firstly sending a first message comprising a communication compression control parameter and a compression threshold parameter to a server, then determining whether to compress the first data message according to the communication compression control parameter and the compression threshold parameter, compressing the first data message according to a preset compression algorithm to generate a second data message, and sending the second data message to the server. Because the first message comprises a communication compression control parameter and a compression threshold parameter, and the first data message is a message with a fixed format obtained by encoding request data sent by an application layer according to a preset communication protocol, before the request message is transmitted, the problem of CPU resource waste caused by compression processing of small data packets can be avoided by judging the relation between the size of the data packet of the first data message and the compression threshold parameter, and whether the first data message is compressed or not and the size of the compression ratio can be determined through the specific numerical value of the communication compression control parameter, so that the data transmission quantity is reduced, the data transmission density is increased, and the data transmission performance under a network bottleneck is improved.
In one embodiment, as shown in fig. 4, there is provided aclient 400 comprising:
a startingmodule 410, configured to send a first message to a server, where the first message is used to request to establish a connection with the server; the first packet includes: a communication compression control parameter and a compression threshold parameter;
acompression module 420, configured to, if the communication compression control parameter is not zero and the size of the data packet of the first data packet is greater than the value of the compression threshold parameter, perform compression processing on the first data packet according to a preset compression algorithm to generate a second data packet; the first data message is a message with a fixed format obtained by encoding request data sent by an application layer according to a preset communication protocol; the second data message is a compressed data message of the first data message and carries compression identification information;
a sendingmodule 430, configured to send the second data packet to the server.
As an optional implementation manner of the embodiment of the present invention, the client further includes:
the receiving response module is used for receiving a second message sent by the server, wherein the second message is used for indicating whether the connection between the client and the server is successful or not;
the judging connection module is used for judging whether the connection between the client and the server is successfully established according to the second message; if the connection is successful, compressing the first data message according to a preset compression algorithm when the communication compression control parameter is not zero and the size of the data packet of the first data message is larger than the value of the compression threshold parameter to generate a second data message.
As an optional implementation manner of the embodiment of the present invention, the client further includes:
the message receiving module is used for receiving a fourth data message sent by the server; the fourth data message is a data message decompressed by the third data message and carries compression identification information; the third data message is a data message generated after the first data message is subjected to database basic operation;
the message decompression module is used for decompressing the fourth data message according to a preset compression algorithm and recovering to obtain a third data message;
and the message sending module is used for sending the third data message to an application layer.
As an optional implementation manner of the embodiment of the present invention, the client further includes:
and the parameter judgment module is used for sending the first data message to the server side if the communication compression control parameter is zero or the size of the data packet of the first data message is smaller than or equal to the value of the compression threshold parameter.
In one embodiment, as shown in fig. 5, there is provided aserver 500 comprising:
aconnection module 510, configured to receive a first message sent by a client, where the first message is used to request to establish a connection with a server; the first packet includes: a communication compression control parameter and a compression threshold parameter;
ananalyzing module 520, configured to analyze the first packet to obtain the communication compression control parameter and the compression threshold parameter;
areceiving module 530, configured to receive a second data packet sent by the client; the second data message is a compressed data message of the first data message and carries compression identification information; the first data message is a message with a fixed format obtained by encoding request data sent by an application layer according to a preset communication protocol;
thedecompression module 540 is configured to decompress the second data packet according to a preset compression algorithm, and recover to obtain a first data packet;
theprocessing module 550 is configured to process the first data packet according to the decompression result to generate a third data packet, where the third data packet is generated after the database basic operation is performed on the first data packet.
As an optional implementation manner of the embodiment of the present invention, the server further includes:
and the response sending module is used for sending a second message to the client, wherein the second message is used for indicating whether the connection between the client and the server is successful.
As an optional implementation manner of the embodiment of the present invention, the server further includes:
the compression processing module is used for decompressing the third data message according to a preset compression algorithm to generate a fourth data message if the communication compression control parameter is not zero and the size of the data packet of the first data message is larger than the value of the compression threshold parameter; the fourth data message is a data message decompressed by the third data message and carries compression identification information;
and the result sending module is used for sending the fourth data message to the client.
Fig. 6 is a schematic structural diagram of the electronic device for data compression and transmission according to the embodiment of the present invention. As shown in fig. 6, the electronic device for data compression and transmission provided by this embodiment includes: amemory 61 and aprocessor 62, thememory 61 being for storing computer programs; theprocessor 62 is configured to execute the steps performed by any of the embodiments of the data compression transmission method provided by the above-mentioned method embodiments when calling the computer program.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media having computer-usable program code embodied in the medium.
The processor may be a Central Processing Unit (CPU), other general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware component, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). The memory is an example of a computer-readable medium.
Computer readable media include both permanent and non-permanent, removable and non-removable storage media. Storage media may implement information storage by any method or technology, and the information may be computer-readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include transitory computer readable media (transmyedia) such as modulated data signals and carrier waves.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The foregoing are merely exemplary embodiments of the present disclosure, which enable those skilled in the art to understand or practice the present disclosure. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A data compression transmission method is applied to a client, and the method comprises the following steps:
sending a first message to a server, wherein the first message is used for requesting to establish connection with the server; the first packet includes: a communication compression control parameter and a compression threshold parameter;
if the communication compression control parameter is not zero and the data packet size of the first data message is larger than the value of the compression threshold parameter, compressing the first data message according to a preset compression algorithm to generate a second data message; the first data message is a message with a fixed format obtained by encoding request data sent by an application layer according to a preset communication protocol; the second data message is a compressed data message of the first data message and carries compression identification information;
and sending the second data message to the server.
2. The method of claim 1, wherein after sending the first packet to the server, the method further comprises:
receiving a second message sent by the server, wherein the second message is used for indicating whether the connection between the client and the server is successful or not;
judging whether the connection between the client and the server is successfully established according to the second message;
if the connection is successful, compressing the first data message according to a preset compression algorithm when the communication compression control parameter is not zero and the size of the data packet of the first data message is larger than the value of the compression threshold parameter to generate a second data message.
3. The method of claim 1, wherein after sending the second data message to the server, the method further comprises:
receiving a fourth data message sent by the server; the fourth data message is a data message decompressed by the third data message and carries compression identification information; the third data message is a data message generated after the first data message is subjected to database basic operation;
decompressing the fourth data message according to a preset compression algorithm, and recovering to obtain a third data message;
and sending the third data message to an application layer.
4. The method of claim 1, further comprising:
and if the communication compression control parameter is zero or the data packet size of the first data message is smaller than or equal to the value of the compression threshold parameter, sending the first data message to the server.
5. A data compression transmission method is applied to a server side, and the method comprises the following steps:
receiving a first message sent by a client, wherein the first message is used for requesting to establish connection with a server; the first packet includes: a communication compression control parameter and a compression threshold parameter;
analyzing the first message to obtain the communication compression control parameter and the compression threshold parameter;
receiving a second data message sent by the client; the second data message is a compressed data message of the first data message and carries compression identification information; the first data message is a message with a fixed format obtained by encoding request data sent by an application layer according to a preset communication protocol;
decompressing the second data message according to a preset compression algorithm, and recovering to obtain a first data message;
and processing the first data message according to the decompression result to generate a third data message, wherein the third data message is generated after the first data message is subjected to database basic operation.
6. The method of claim 5, wherein after receiving the first message sent by the client, the method further comprises:
and sending a second message to the client, wherein the second message is used for indicating whether the connection between the client and the server is successful.
7. The method of claim 5, wherein after processing the first datagram according to the decompression result to generate a third datagram, the method further comprises:
if the communication compression control parameter is not zero and the size of the data packet of the first data message is larger than the value of the compression threshold parameter, decompressing the third data message according to a preset compression algorithm to generate a fourth data message; the fourth data message is a data message decompressed by the third data message and carries compression identification information;
and sending the fourth data message to the client.
8. A client, comprising:
the starting module is used for sending a first message to the server, and the first message is used for requesting to establish connection with the server; the first packet includes: a communication compression control parameter and a compression threshold parameter;
the compression module is used for compressing the first data message according to a preset compression algorithm to generate a second data message if the communication compression control parameter is not zero and the size of the data packet of the first data message is larger than the value of the compression threshold parameter; the first data message is a message with a fixed format obtained by encoding request data sent by an application layer according to a preset communication protocol; the second data message is a compressed data message of the first data message and carries compression identification information;
and the sending module is used for sending the second data message to the server.
9. A server, comprising:
the connection module is used for receiving a first message sent by a client, wherein the first message is used for requesting to establish connection with a server; the first packet includes: a communication compression control parameter and a compression threshold parameter;
the analysis module is used for analyzing the first message to obtain the communication compression control parameter and the compression threshold parameter;
the receiving module is used for receiving a second data message sent by the client; the second data message is a compressed data message of the first data message and carries compression identification information; the first data message is a message with a fixed format obtained by encoding request data sent by an application layer according to a preset communication protocol;
the decompression module is used for decompressing the second data message according to a preset compression algorithm and recovering to obtain a first data message;
and the processing module is used for processing the first data message according to the decompression result to generate a third data message, wherein the third data message is generated after the first data message is subjected to database basic operation.
10. An electronic device comprising a memory and a processor, the memory storing a computer program, wherein the processor implements the steps of the data compression transmission method according to any one of claims 1 to 7 when executing the computer program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111396502.7ACN114125071B (en) | 2021-11-23 | 2021-11-23 | Data compression transmission method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111396502.7ACN114125071B (en) | 2021-11-23 | 2021-11-23 | Data compression transmission method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114125071Atrue CN114125071A (en) | 2022-03-01 |
| CN114125071B CN114125071B (en) | 2024-02-09 |
Family
ID=80440064
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111396502.7AActiveCN114125071B (en) | 2021-11-23 | 2021-11-23 | Data compression transmission method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114125071B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115134425A (en)* | 2022-06-20 | 2022-09-30 | 北京京东乾石科技有限公司 | A message processing method and device |
| WO2024152689A1 (en)* | 2023-01-18 | 2024-07-25 | 华为技术有限公司 | Parameter notification method and apparatus, and device and system |
Citations (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CA2365571A1 (en)* | 2001-12-18 | 2003-06-18 | Cognos Incorporated | System and method for retrieving data from a database system |
| US20080077702A1 (en)* | 2006-09-27 | 2008-03-27 | Joshua Posamentier | Dynamic server stream allocation |
| CN102111437A (en)* | 2010-12-30 | 2011-06-29 | 浪潮集团山东通用软件有限公司 | Simple object access protocol (SOAP) extension-based WEB service transmission compression method |
| CN102428483A (en)* | 2009-03-23 | 2012-04-25 | 生命力有限公司 | System and Method for Multi-Stream Video Compression |
| CN102790766A (en)* | 2012-06-29 | 2012-11-21 | 华为技术有限公司 | Object query method, object query system, object query device and object query acquisition device |
| CN103561082A (en)* | 2013-10-30 | 2014-02-05 | 北京奇虎科技有限公司 | Compressing request processing method and server |
| US20140304294A1 (en)* | 2013-04-06 | 2014-10-09 | Citrix Systems, Inc. | Systems and methods for caching of sql responses using integrated caching |
| US20160134723A1 (en)* | 2014-11-11 | 2016-05-12 | Dell Products, L.P. | Adaptive compression management for web services |
| US9532268B2 (en)* | 2014-11-19 | 2016-12-27 | Qualcomm Incorporated | Methods and apparatus for synchronizing a user equipment with an HFN offset |
| WO2017124837A1 (en)* | 2016-01-19 | 2017-07-27 | 深圳前海达闼云端智能科技有限公司 | Proxy method, server and client for sslvpn, and processing method thereof |
| CN107395716A (en)* | 2017-07-19 | 2017-11-24 | 河南神州数码索贝科技有限公司 | A kind of mobile terminal picture compression method for uploading and device |
| CN110572375A (en)* | 2019-08-21 | 2019-12-13 | 北京金堤科技有限公司 | IP address proxy method and device |
| CN110597461A (en)* | 2019-08-14 | 2019-12-20 | 阿里巴巴集团控股有限公司 | Data storage method, device and equipment in block chain type account book |
| CN110611680A (en)* | 2019-09-25 | 2019-12-24 | 腾讯科技（深圳）有限公司 | Data packet compression control method and device |
| CN111224864A (en)* | 2020-01-14 | 2020-06-02 | 平安国际智慧城市科技股份有限公司 | Message transmission method and device, computer equipment and storage medium |
| US10694002B1 (en)* | 2017-04-27 | 2020-06-23 | EMC IP Holding Company LLC | Data compression optimization based on client clusters |
| US20200210411A1 (en)* | 2019-08-14 | 2020-07-02 | Alibaba Group Holding Limited | Data storage in blockchain-type ledger |
| CN111935261A (en)* | 2020-07-30 | 2020-11-13 | 北京达佳互联信息技术有限公司 | Response message processing method and device, electronic equipment and storage medium |
| CN112887429A (en)* | 2021-03-08 | 2021-06-01 | 深圳市车宝信息科技有限公司 | Data transmission method and device, electronic equipment and storage medium |
- 2021
- 2021-11-23CNCN202111396502.7Apatent/CN114125071B/enactiveActive
Patent Citations (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CA2365571A1 (en)* | 2001-12-18 | 2003-06-18 | Cognos Incorporated | System and method for retrieving data from a database system |
| US20080077702A1 (en)* | 2006-09-27 | 2008-03-27 | Joshua Posamentier | Dynamic server stream allocation |
| CN102428483A (en)* | 2009-03-23 | 2012-04-25 | 生命力有限公司 | System and Method for Multi-Stream Video Compression |
| CN102111437A (en)* | 2010-12-30 | 2011-06-29 | 浪潮集团山东通用软件有限公司 | Simple object access protocol (SOAP) extension-based WEB service transmission compression method |
| CN102790766A (en)* | 2012-06-29 | 2012-11-21 | 华为技术有限公司 | Object query method, object query system, object query device and object query acquisition device |
| US20140304294A1 (en)* | 2013-04-06 | 2014-10-09 | Citrix Systems, Inc. | Systems and methods for caching of sql responses using integrated caching |
| US20160110416A1 (en)* | 2013-04-06 | 2016-04-21 | Citrix Systems, Inc. | Systems and methods for caching of sql responses using integrated caching |
| CN103561082A (en)* | 2013-10-30 | 2014-02-05 | 北京奇虎科技有限公司 | Compressing request processing method and server |
| US20160134723A1 (en)* | 2014-11-11 | 2016-05-12 | Dell Products, L.P. | Adaptive compression management for web services |
| US9532268B2 (en)* | 2014-11-19 | 2016-12-27 | Qualcomm Incorporated | Methods and apparatus for synchronizing a user equipment with an HFN offset |
| WO2017124837A1 (en)* | 2016-01-19 | 2017-07-27 | 深圳前海达闼云端智能科技有限公司 | Proxy method, server and client for sslvpn, and processing method thereof |
| US10694002B1 (en)* | 2017-04-27 | 2020-06-23 | EMC IP Holding Company LLC | Data compression optimization based on client clusters |
| CN107395716A (en)* | 2017-07-19 | 2017-11-24 | 河南神州数码索贝科技有限公司 | A kind of mobile terminal picture compression method for uploading and device |
| CN110597461A (en)* | 2019-08-14 | 2019-12-20 | 阿里巴巴集团控股有限公司 | Data storage method, device and equipment in block chain type account book |
| US20200210411A1 (en)* | 2019-08-14 | 2020-07-02 | Alibaba Group Holding Limited | Data storage in blockchain-type ledger |
| CN110572375A (en)* | 2019-08-21 | 2019-12-13 | 北京金堤科技有限公司 | IP address proxy method and device |
| CN110611680A (en)* | 2019-09-25 | 2019-12-24 | 腾讯科技（深圳）有限公司 | Data packet compression control method and device |
| CN111224864A (en)* | 2020-01-14 | 2020-06-02 | 平安国际智慧城市科技股份有限公司 | Message transmission method and device, computer equipment and storage medium |
| CN111935261A (en)* | 2020-07-30 | 2020-11-13 | 北京达佳互联信息技术有限公司 | Response message processing method and device, electronic equipment and storage medium |
| CN112887429A (en)* | 2021-03-08 | 2021-06-01 | 深圳市车宝信息科技有限公司 | Data transmission method and device, electronic equipment and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 靳松: "微影用户中心性能调优探索与实践", 现代电影技术, pages 38 - 42* |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115134425A (en)* | 2022-06-20 | 2022-09-30 | 北京京东乾石科技有限公司 | A message processing method and device |
| WO2024152689A1 (en)* | 2023-01-18 | 2024-07-25 | 华为技术有限公司 | Parameter notification method and apparatus, and device and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114125071B (en) | 2024-02-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11711420B2 (en) | Automated management of resource attributes across network-based services | |
| US9477682B1 (en) | Parallel compression of data chunks of a shared data object using a log-structured file system | |
| CN109902274B (en) | Method and system for converting json character string into thraft binary stream | |
| US10706018B2 (en) | Bandwidth-efficient installation of software on target devices using reference code libraries | |
| US11366790B2 (en) | System and method for random-access manipulation of compacted data files | |
| CN104408100B (en) | The compression method of structured web site daily record | |
| CN108628898B (en) | Data storage method, device and device | |
| CN114125071B (en) | Data compression transmission method and device | |
| CN113238912B (en) | Aggregation processing method for network security log data | |
| US12224776B2 (en) | System and method for data storage, transfer, synchronization, and security using automated model monitoring and training | |
| US20250047300A1 (en) | System and method for data processing and transformation using reference data structures | |
| US20230106736A1 (en) | System and method for low-distortion compaction of floating-point numbers | |
| US11494437B1 (en) | System and method for performing object-modifying commands in an unstructured storage service | |
| US11733867B2 (en) | System and method for multiple pass data compaction utilizing delta encoding | |
| US12136934B2 (en) | Event-driven data transmission using codebooks with protocol adaption | |
| US20240086068A1 (en) | System and method for data compaction utilizing distributed codebook encoding | |
| CN115168311A (en) | An alarm event processing method, system, storage medium and terminal | |
| US20220327098A1 (en) | System and method for computer data type identification | |
| US12261632B2 (en) | System and method for data storage, transfer, synchronization, and security using automated model monitoring and training with dyadic distribution-based simultaneous compression and encryption | |
| CN112436943A (en) | Request deduplication method, device, equipment and storage medium based on big data | |
| US12218697B2 (en) | Event-driven data transmission using codebooks with protocol prediction and translation | |
| CN119968777A (en) | Multi-domain configurable data compressor/decompressor | |
| Kattan et al. | Evolution of human-competitive lossless compression algorithms with GP-zip2 | |
| US11734012B2 (en) | Systems and methods for efficient transfer of log data | |
| CN104216914B (en) | large-capacity data transmission |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address | Address after:100102 201, 2 / F, 101, No. 5 building, No. 7 Rongda Road, Chaoyang District, Beijing Patentee after:China Electronics Technology Group Jincang (Beijing) Technology Co.,Ltd. Country or region after:China Address before:100102 201, 2 / F, 101, No. 5 building, No. 7 Rongda Road, Chaoyang District, Beijing Patentee before:BEIJING KINGBASE INFORMATION TECHNOLOGIES Inc. Country or region before:China | |
| CP03 | Change of name, title or address |