CN109639773B - Dynamically constructed distributed data cluster control system and method thereof - Google Patents
Dynamically constructed distributed data cluster control system and method thereofDownload PDFInfo
- Publication number
- CN109639773B CN109639773BCN201811417178.0ACN201811417178ACN109639773BCN 109639773 BCN109639773 BCN 109639773BCN 201811417178 ACN201811417178 ACN 201811417178ACN 109639773 BCN109639773 BCN 109639773B
- Authority
- CN
- China
- Prior art keywords
- data
- node
- cluster
- service
- nodes
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034methodMethods0.000titleclaimsabstractdescription27
- 238000007726management methodMethods0.000claimsdescription45
- 238000004891communicationMethods0.000claimsdescription7
- 238000013500data storageMethods0.000claimsdescription5
- 238000012163sequencing techniqueMethods0.000claimsdescription4
- 230000001360synchronised effectEffects0.000claimsdescription2
- 238000012545processingMethods0.000abstractdescription4
- 238000013523data managementMethods0.000abstractdescription3
- 238000010276constructionMethods0.000abstract1
- 238000005516engineering processMethods0.000description4
- 238000013508migrationMethods0.000description2
- 230000005012migrationEffects0.000description2
- 238000011160researchMethods0.000description2
- 238000013473artificial intelligenceMethods0.000description1
- 238000004364calculation methodMethods0.000description1
- 238000011161developmentMethods0.000description1
- 238000010586diagramMethods0.000description1
- 230000002085persistent effectEffects0.000description1
- 230000004044responseEffects0.000description1
- 230000004043responsivenessEffects0.000description1
Images
Classifications
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0654—Management of faults, events, alarms or notifications using network fault recovery
- H04L41/0659—Management of faults, events, alarms or notifications using network fault recovery by isolating or reconfiguring faulty entities
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/10—Active monitoring, e.g. heartbeat, ping or trace-route
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/14—Session management
- H04L67/141—Setup of application sessions
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Cardiology (AREA)
- General Health & Medical Sciences (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Description
Technical Field
The invention belongs to the field of distributed control systems, and particularly relates to a dynamically constructed distributed data cluster control system and a method thereof.
Background
At present, with the development of technologies such as big data technology, cloud technology, artificial intelligence and the like, the data volume is larger and larger, and the storage and processing of data are concerned more. In order to better provide system services and data processing, distributed clustering becomes a better technical architecture and implementation scheme. The distributed cluster provides support for data distribution, local caching, copy redundancy backup, fault tolerance, transaction, concurrency control and the like for system application, ensures data consistency in the processes of data migration, fault tolerance and concurrent reading and writing, and simultaneously provides storage access support and data synchronization of a remote central database for the application. At present, under the condition that the existing distributed cluster can not provide stable data service scenes, the distributed data cluster is dynamically constructed, dynamic addition and dynamic removal of data nodes are realized, and the flexibility of the distributed cluster data service is reduced. Meanwhile, with the high concurrency characteristic of a data service scene, how to improve the low delay index of the data service also becomes an important research direction in the field of distributed clusters at present.
The following 2 problems exist in the current distributed cluster in specific application:
(1) how to dynamically construct a distributed data cluster and ensure the consistency of data. The dynamic establishment of the distributed data cluster is composed of two conditions of newly adding a data node and removing a fault data node, and on the basis of ensuring that the existing data node provides stable and reliable service, the dynamic establishment of the new data cluster by adopting which strategy is one of important research directions in the current distributed field.
(2) The method and the device solve the problems that under the scenes that the number of distributed data cluster data nodes is large and the data communication traffic is large, the communication efficiency among the data nodes is improved, the data synchronization efficiency is improved, and the data management meets the requirement of low delay.
Disclosure of Invention
The technical problem to be solved by the invention is to provide a dynamically constructed distributed data cluster control system and a method thereof, wherein the system can provide dynamically configurable data node addition and removal, ensure the data consistency among data nodes and provide low-delay service for data reading and writing.
The technical solution for realizing the purpose of the invention is as follows: a dynamically constructed distributed data cluster control system comprises a server device, a management device and N client devices, wherein the server device is simultaneously connected with the client devices and the management device; the server device comprises a plurality of service data node instances, all the service data node instances form a service node cluster, each service data node instance is called a service node, one service node serves as a central main node of the service node cluster, and the rest service nodes are data slave nodes;
the server device is used for analyzing and loading the network and basic configuration information of the distributed data cluster nodes;
the management end device provides an interface for managing the distributed data cluster for a user, and the user can inquire the state and data information of the distributed data cluster through a query language and can initialize data and update the data; the cluster state is that the service node works normally or fails;
and the client device is used for inquiring the central main node, establishing connection and executing data synchronization and data updating operation.
A dynamically constructed distributed data cluster control method based on the system comprises the following steps:
step 6, the management end device cannot acquire the data version of the server end device, namely the distributed data cluster of the server end device is shown as a newly constructed cluster, and the database table structure of the management end device initializes the data of the server end device;
step 7, the client device establishes connection with the server device for communication, and acquires a central main node for connection; the client device continuously detects the connection state of the client device and the central main node, and if the central main node fails, a new central main node is obtained for connection;
step 8, the server device has new data information and informs the client device to carry out data synchronization operation;
step 9, the client device inquires the data inside the server device to provide data service under the condition that the server device has no data updating notice;
step 10, the management terminal device inquires the state and the data state of each node of the distributed data cluster in the server terminal device;
step 11, the management terminal device queries the data version of the server terminal device through a data query language;
step 12, after respective data versions of the management side device and the client side device are updated, synchronously updating the data versions into a database of the server side device;
and step 13, the server side device distributes the new version data to the management side device and the client side device for data synchronization.
Compared with the prior art, the invention has the following remarkable advantages: 1) when the data node receives a plurality of data updates, the data nodes are put into one transaction and submitted to the database together, so that the low-delay index of data synchronization is improved; 2) according to the invention, the data updating is registered through the central main node, and other nodes are immediately informed of the data updating, so that the timeliness index of the data updating is improved; 3) the invention saves the continuous data updating in the memory of the central main node in an incremental mode for a certain time, thereby reducing the data processing amount; 4) the data nodes in the invention update the data through the central node, thereby ensuring the consistency of the data.
The present invention is described in further detail below with reference to the attached drawing figures.
Drawings
Fig. 1 is a schematic structural diagram of a dynamically constructed distributed data cluster control system according to the present invention.
FIG. 2 is a flow chart of a dynamically constructed distributed data cluster control method according to the present invention.
FIG. 3 is a flow chart of data synchronization in the dynamically constructed distributed data cluster control method of the present invention.
FIG. 4 is a flowchart of data update in the dynamically constructed distributed data cluster control method according to the present invention.
Detailed Description
With reference to fig. 1, the dynamically constructed distributed data cluster control system of the present invention is characterized in that the system includes aserver device 1, amanagement device 2, andN client devices 3, where theserver device 1 is connected to theclient devices 3 and themanagement device 2 at the same time; theserver device 1 comprises a plurality of service data node instances, all the service data node instances form a service node cluster, each service data node instance is called a service node, one service node serves as a central main node of the service node cluster, and the rest service nodes are data slave nodes;
theserver device 1 is configured to parse and load network and basic configuration information of the distributed data cluster nodes, where the basic configuration information includes distributed cluster data node configuration information, distributed cluster data node network configuration information, data storage configuration information, and log record configuration information.
Themanagement end device 2 provides an interface for managing the distributed data cluster for a user, and the user can inquire the state and the data information of the distributed data cluster through a query language and can initialize data and update the data; the cluster state is that the service node works normally or fails. Before the distributed data cluster runs, the management-side device 2 initializes the data structure, that is, establishes a database table structure.
And theclient device 3 is used for inquiring the central main node and establishing connection, and executing data synchronization and data updating operation.
Further, one service node is used as a central host node of the service node cluster, and the specific process of selecting the central host node is as follows:
1) presetting a priority for each service node in the service node cluster, wherein the priorities corresponding to the service nodes are the same or different;
2) sorting the priority in descending order;
3) if only one service node corresponding to the maximum priority is available, taking the service node as a central main node; if a plurality of service nodes corresponding to the maximum priority are available, one service node is randomly selected as a central main node through a Hash method;
4) theclient device 3 sends heartbeat packets to the server device at regular time, if a certain service node fails to receive the heartbeat packets within the set time, namely the service node fails, the service node is removed from the service node cluster, the data of the service node is copied to other service nodes, and if the central main node is removed, the steps 2) and 3) are repeated to reselect the central main node from the rest service nodes.
With reference to fig. 2, the dynamically constructed distributed data cluster control method of the present invention includes the following steps:
step 6, themanagement end device 2 does not obtain the data version of theserver end device 1, namely, the distributed data cluster of theserver end device 1 is shown as a newly constructed cluster, and the database table structure of themanagement end device 2 initializes the data of theserver end device 1;
step 7, theclient device 3 establishes connection with theserver device 1 for communication, and acquires a central main node for connection; theclient device 3 continuously detects the connection state between the client device and the central main node, and if the central main node fails, a new central main node is obtained for connection;
step 8, theserver device 1 has new data information and notifies theclient device 3 to perform data synchronization operation as shown in fig. 3, which specifically includes:
step 8-1, the data of oneclient device 3 is updated and registered by the central main node of theserver device 1;
step 8-2, the central main node informs other data slave nodes of theserver side device 1 to update data;
if the data of the plurality ofclient devices 3 are updated in sequence, the central master node registers in sequence according to the updating sequence and stores the data for a certain time in the memory of the central master node to obtain a data updating packet, submits the data updating packet to the database of theserver device 1, and then notifies other data slave nodes to update the data;
step 9, theclient device 3 queries the internal data of theserver device 1 under the condition that the server device does not have a data updating notice so as to provide data service, so that the service responsiveness is improved;
step 10, themanagement terminal device 2 queries the state and data state of each node of the distributed data cluster in theserver device 1;
step 11, themanagement terminal device 2 queries the data version of theserver terminal device 1 through the data query language;
step 12, after the respective data versions of themanagement device 2 and theclient device 3 are updated, they are all updated into the database of theserver device 1 in synchronization as shown in fig. 4, specifically:
step 12-1, a certain data node, namely themanagement end device 2 or a certainclient end device 3, writes the update of the data into a memory to form a data packet;
step 12-2, when the transaction is submitted, the data packet is sent to a central main node;
and step 12-3, analyzing data conflicts:
1) at any time, the data states of the central nodes are the final states of the data;
2) when the data of the data node lags behind the central node, the data can still be updated, but:
1) the data node cannot add an entry that already exists on the central node. Wherein the items are determined by primary keys, identical primary keys being considered to be identical items;
2) the data node cannot delete entries that do not exist on the central node;
3) the data node can not modify the modified entry on the central node, namely when the entry of the central node is inconsistent with the entry of the data node, the data node can not modify the entry;
3) when the data of the data node lags behind the data of the central main node and causes update conflict, the data is rolled back and cannot be submitted to a database of the data node;
4) when the data of the data node lags behind the data of the central main node and leads to update conflict, the data node is actively synchronized with the central main node;
step 12-4, the central master node writes the received data packet into a database of the central master node, immediately sends the data packet to other data nodes, namely themanagement end device 2 or theclient end device 3, and simultaneously puts the data packet into a memory queue to queue and write the data packet into persistent storage, so that the data packet does not need to be returned after the completion of disk IO operation, and the disk IO delay is reduced; and if the data node receives a plurality of data packets at the same time, submitting the data packets to the database of the data node for updating.
Step 13, theserver device 1 distributes the new version data to themanagement device 2 and theclient device 3 to perform data synchronization.
Further, the connection between themanagement device 2 and theserver device 1 instep 4 and the connection between theclient device 3 and theserver device 1 in step 7 are both established as TCP communication connections.
Further, the data packet is sent to the central main node in the step 12-2 in a TCP _ NODELAY mode, so that the data packet is sent immediately when being forced to be transmitted, and the network delay is reduced.
Further, after the data packet is immediately sent to other data nodes in step 12-4, the data nodes will communicate with the central host node regularly to query the data state, and when the data nodes update data conflicts, the data nodes are immediately updated.
In summary, by using the technical scheme of the invention, a distributed data cluster can be dynamically constructed in a stable data service scene, and functional supports such as data distribution, local cache, copy redundancy backup, fault tolerance, transaction, concurrency control and the like are provided; the consistency of data is ensured in the processes of data migration, fault tolerance and concurrent reading and writing, and the storage access support and the data synchronization of a remote central database are provided for the application; aiming at the problems of calculation delay, network delay, disk IO delay and the like of a processor, a low-delay guarantee technology of data management is adopted, and the response timeliness of data updating and synchronization is improved.
Claims (9)
1. A dynamically constructed distributed data cluster control system is characterized by comprising a server device (1), a management device (2) and N client devices (3), wherein the server device (1) is connected with the client devices (3) and the management device (2) at the same time; the server device (1) comprises a plurality of service data node instances, all the service data node instances form a service node cluster, each service data node instance is called a service node, one service node serves as a central main node of the service node cluster, and the rest service nodes are data slave nodes;
the server device (1) is used for analyzing and loading network and basic configuration information of the distributed data cluster nodes;
the management end device (2) provides an interface for managing the distributed data cluster for a user, and the user can inquire the state and data information of the distributed data cluster through a query language, initialize data and update the data; the cluster state is that the service node works normally or fails;
the client device (3) is used for inquiring the central main node, establishing connection and executing data synchronization and data updating operation;
the service node is used as a central main node of the service node cluster, and the specific process of selecting the central main node is as follows:
1) presetting a priority for each service node in the service node cluster, wherein the priorities corresponding to the service nodes are the same or different;
2) sorting the priority in descending order;
3) judging the number of service nodes corresponding to the maximum priority, and if only one service node corresponding to the maximum priority exists, taking the service node as a central main node; if a plurality of service nodes corresponding to the maximum priority are available, one service node is randomly selected as a central main node through a Hash method;
4) the client device (3) sends heartbeat packets to the server device at regular time, if a certain service node fails to receive the heartbeat packets within set time, namely the service node fails, the service node is removed from the service node cluster, data of the service node is copied to other service nodes, and if the central main node is removed, the step 2) and the step 3) are repeated to reselect the central main node from the rest service nodes until the normally working central main node is selected;
running distributed data cluster nodes with parameters, and orderly adding newly added nodes into a cluster data queue one by one; sequencing the service nodes into an ordered ring according to the size of the Hash value of each service node in the service end device (1); and then each service node is connected with the right side node which is closest to the service node and normally works to form a stable ordered closed loop, and a dynamic distributed data cluster is constructed.
2. The dynamically constructed distributed data cluster control system of claim 1, wherein the base configuration information comprises distributed cluster data node configuration information, distributed cluster data node network configuration information, data storage configuration information, logging configuration information.
3. The dynamically constructed distributed data cluster control system according to claim 1, wherein before the distributed data cluster is operated, the management-side device (2) initializes a data structure to establish a database table structure.
4. A dynamically constructed distributed data cluster control method based on the system of claim 3, comprising the steps of:
step 1, analyzing the configuration information of the distributed data cluster through a server device (1); the method specifically comprises cluster node configuration information, cluster node network configuration information, data storage configuration information and log record configuration information;
step 2, running distributed data cluster nodes with parameters, and orderly adding newly added nodes into a cluster data queue one by one;
step 3, sequencing the service nodes into an ordered ring according to the size of the Hash value of each service node in the service end device (1); then, each service node is connected with the right side node which is closest to the service node and normally works to form a stable ordered closed loop, and a dynamic distributed data cluster is constructed;
step 4, the management end device (2) establishes connection with the server end device (1);
step 5, comparing the data versions of the management terminal device (2) and the server terminal device (1), and if the data version of the server terminal device (1) is newer than the data version of the management terminal device (2), executing data synchronization operation to update the data version of the management terminal device (2);
step 6, the management end device (2) cannot acquire the data version of the server end device (1), namely, the distributed data cluster of the server end device (1) is a newly constructed cluster, and the database table structure of the management end device (2) initializes the data of the server end device (1);
step 7, the client device (3) establishes connection with the server device (1) for communication, and acquires a central main node for connection; the client device (3) uninterruptedly detects the connection state between the client device and the central main node, and acquires a new central main node for connection if the central main node fails;
step 8, the server device (1) has new data information and informs the client device (3) to carry out data synchronization operation;
step 9, the client device (3) queries the data inside the server device (1) under the condition that the server device does not have a data updating notice so as to provide data service;
step 10, the management end device (2) queries the state and the data state of each node of the distributed data cluster in the server end device (1);
step 11, the management terminal device (2) queries the data version of the server terminal device (1) through a data query language;
step 12, after respective data versions of the management terminal device (2) and the client terminal device (3) are updated, synchronously updating the data versions to a database of the server terminal device (1);
and step 13, the server device (1) distributes the new version data to the management device (2) and the client device (3) for data synchronization.
5. The dynamically constructed distributed data cluster control method according to claim 4, wherein the connection between the management device (2) and the server device (1) in step 4, and the connection between the client device (3) and the server device (1) in step 7 are both established by establishing a TCP communication connection.
6. The dynamically constructed distributed data cluster control method according to claim 4 or 5, wherein the server device (1) has new data information in step 8, and notifies the client device (3) to perform data synchronization operation, specifically:
step 8-1, updating data of one client device (3), and registering by a central main node of the server device (1);
step 8-2, the central main node informs other data slave nodes of the server side device (1) to update data;
if the data of the client devices (3) are updated in sequence, the central main node registers in sequence according to the updating sequence and stores the data for a certain time in the memory of the central main node to obtain a data updating packet, and submits the data updating packet to the database of the server device (1), and then notifies other data slave nodes to update the data.
7. The dynamically constructed distributed data cluster control method according to claim 4 or 5, wherein, after the respective data versions of the management-side device (2) and the client-side device (3) are updated in step 12, both the data versions are synchronously updated into the database of the server-side device (1), specifically:
step 12-1, a certain data node, namely the management end device (2) or a certain client end device (3), writes the update of the data into a memory to form a data packet;
step 12-2, when the transaction is submitted, the data packet is sent to a central main node;
and step 12-3, analyzing data conflicts:
1) when the data of the data node lags behind the data of the central main node and causes update conflict, the data is rolled back and cannot be submitted to a database of the data node;
2) when the data of the data node lags behind the data of the central main node and leads to update conflict, the data node is actively synchronized with the central main node;
step 12-4, the central main node writes the received data packet into a database of the central main node, and immediately sends the data packet to other data nodes, namely, a management end device (2) or a client device (3); and if the data node receives a plurality of data packets at the same time, submitting the data packets to the database of the data node for updating.
8. The dynamically constructed distributed data cluster control method of claim 7, wherein the step 12-2 of sending the data packet to the central master node is in a TCP _ NODELAY manner.
9. The dynamically constructed distributed data cluster control method according to claim 7, wherein after the data packet is sent to other data nodes in step 12-4, the data nodes will periodically communicate with the central master node to query the data state, and when the data node update data conflicts, the data node update is performed immediately.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811417178.0ACN109639773B (en) | 2018-11-26 | 2018-11-26 | Dynamically constructed distributed data cluster control system and method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811417178.0ACN109639773B (en) | 2018-11-26 | 2018-11-26 | Dynamically constructed distributed data cluster control system and method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109639773A CN109639773A (en) | 2019-04-16 |
| CN109639773Btrue CN109639773B (en) | 2021-04-13 |
Family
ID=66069181
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811417178.0AActiveCN109639773B (en) | 2018-11-26 | 2018-11-26 | Dynamically constructed distributed data cluster control system and method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109639773B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111163176A (en)* | 2020-01-02 | 2020-05-15 | 山东超越数控电子股份有限公司 | VirtualBox-based cluster management system |
| CN111460030A (en)* | 2020-03-18 | 2020-07-28 | 紫光云技术有限公司 | ZooKeeper-based distributed data exchange system |
| CN112532625B (en)* | 2020-11-27 | 2022-09-13 | 杭州安恒信息安全技术有限公司 | Network situation awareness evaluation data updating method and device and readable storage medium |
| CN113783921A (en)* | 2021-01-27 | 2021-12-10 | 北京京东振世信息技术有限公司 | Method and apparatus for creating cache components |
| CN115329391B (en)* | 2022-10-18 | 2023-01-24 | 成都卫士通信息产业股份有限公司 | Text database protection method, device, equipment and medium |
| CN117851459B (en)* | 2024-03-08 | 2024-06-07 | 江苏金恒信息科技股份有限公司 | Data processing method based on multi-level cache under industrial data acquisition |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102025550A (en)* | 2010-12-20 | 2011-04-20 | 中兴通讯股份有限公司 | System and method for managing data in distributed cluster |
| CN103475566A (en)* | 2013-07-10 | 2013-12-25 | 北京发发时代信息技术有限公司 | Real-time message exchange platform and distributed cluster establishment method |
| CN104753994A (en)* | 2013-12-27 | 2015-07-01 | 杭州海康威视系统技术有限公司 | Method and device for data synchronization based on cluster server system |
| CN105824810A (en)* | 2015-01-04 | 2016-08-03 | 中国移动通信集团河北有限公司 | Hadoop cluster system and data processing method |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9998544B2 (en)* | 2014-08-11 | 2018-06-12 | Sas Institute Inc. | Synchronization testing of active clustered servers |
- 2018
- 2018-11-26CNCN201811417178.0Apatent/CN109639773B/enactiveActive
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102025550A (en)* | 2010-12-20 | 2011-04-20 | 中兴通讯股份有限公司 | System and method for managing data in distributed cluster |
| CN103475566A (en)* | 2013-07-10 | 2013-12-25 | 北京发发时代信息技术有限公司 | Real-time message exchange platform and distributed cluster establishment method |
| CN104753994A (en)* | 2013-12-27 | 2015-07-01 | 杭州海康威视系统技术有限公司 | Method and device for data synchronization based on cluster server system |
| CN105824810A (en)* | 2015-01-04 | 2016-08-03 | 中国移动通信集团河北有限公司 | Hadoop cluster system and data processing method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109639773A (en) | 2019-04-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109639773B (en) | Dynamically constructed distributed data cluster control system and method thereof | |
| CN112199427B (en) | A data processing method and system | |
| US7457835B2 (en) | Movement of data in a distributed database system to a storage location closest to a center of activity for the data | |
| CN111694865A (en) | Four-layer structure data acquisition method and device based on distributed system | |
| EP2062125B1 (en) | System and method for providing high availability data | |
| US20100106915A1 (en) | Poll based cache event notifications in a distributed cache | |
| US10127077B2 (en) | Event distribution pattern for use with a distributed data grid | |
| US11068499B2 (en) | Method, device, and system for peer-to-peer data replication and method, device, and system for master node switching | |
| US20140156586A1 (en) | Big-fast data connector between in-memory database system and data warehouse system | |
| EP1330907A2 (en) | Method and apparatus for real-time parallel delivery of segments of a large payload file | |
| CN103428288B (en) | Based on the copies synchronized method of subregion state table and coordinator node | |
| EP3347815B1 (en) | Action-based routing of a transaction in an online transaction processing system | |
| US7693882B2 (en) | Replicating data across the nodes in a cluster environment | |
| CN112948178A (en) | Data processing method, device, system, equipment and medium | |
| JP7678892B2 (en) | Geographically Distributed Hybrid Cloud Clusters | |
| CN111382132A (en) | Medical image data cloud storage system | |
| CN110807039A (en) | A system and method for maintaining data consistency in cloud computing environment | |
| CN109726211B (en) | Distributed time sequence database | |
| CN115964444B (en) | Cloud native distributed multi-tenant database implementation method and system | |
| CN112966047B (en) | Method for realizing table copying function based on distributed database | |
| CN117171271A (en) | Local cache synchronization method and system based on microservices and version number mechanism | |
| JP7515693B2 (en) | Randomizing heartbeat communication between multiple partition groups | |
| CN114791850A (en) | Task processing method and device thereof, and computer-readable storage medium | |
| CN114448781B (en) | Data processing system | |
| EA027808B1 (en) | Database management system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP01 | Change in the name or title of a patent holder | Address after:222001 No.18 Shenghu Road, Lianyungang City, Jiangsu Province Patentee after:The 716th Research Institute of China Shipbuilding Corp. Address before:222001 No.18 Shenghu Road, Lianyungang City, Jiangsu Province Patentee before:716TH RESEARCH INSTITUTE OF CHINA SHIPBUILDING INDUSTRY Corp. | |
| CP01 | Change in the name or title of a patent holder |