CN114328618A - A cache data synchronization method, device, device and storage medium - Google Patents
A cache data synchronization method, device, device and storage mediumDownload PDFInfo
- Publication number
- CN114328618A CN114328618ACN202111445506.XACN202111445506ACN114328618ACN 114328618 ACN114328618 ACN 114328618ACN 202111445506 ACN202111445506 ACN 202111445506ACN 114328618 ACN114328618 ACN 114328618A
- Authority
- CN
- China
- Prior art keywords
- data
- server
- cache data
- file
- middleware system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Information Transfer Between Computers (AREA)
Abstract
Description
Translated fromChinese技术领域technical field
本发明涉及计算机技术领域，特别涉及一种缓存数据同步方法、装置、设备及介质。The present invention relates to the field of computer technology, and in particular, to a cache data synchronization method, device, device and medium.
背景技术Background technique
为提高应用系统中系统的访问速度，往往在应用层面加入缓存机制，也就是将查询的数据放在内存中，Redis(Remote Dictionary Server，远程字典服务)是对缓存数据管理的重要内存数据库。在多服务集群模式下的数据缓存的管理既要保证数据的一致性，又要保证数据的实时性，及时可靠是对缓存同步的一个基本要求。现有的远程字典服务中缓存数据的同步方式可以分为以下几种：In order to improve the access speed of the system in the application system, a cache mechanism is often added at the application level, that is, the queried data is placed in the memory. Redis (Remote Dictionary Server, remote dictionary service) is an important in-memory database for cache data management. The management of the data cache in the multi-service cluster mode must not only ensure the consistency of the data, but also ensure the real-time nature of the data. Timely and reliable is a basic requirement for cache synchronization. The synchronization methods of cached data in the existing remote dictionary service can be divided into the following types:
(1)如图1所示，应用服务器连接多个Redis服务器，多个Redis服务器分别对应多个客户端，实现缓存数据的同步，这种方式的缺点是：应用服务器需要同步连接多个Redis服务，也即应用服务器的压力增加。(1) As shown in Figure 1, the application server connects to multiple Redis servers, and the multiple Redis servers correspond to multiple clients respectively to realize the synchronization of cached data. The disadvantage of this method is that the application server needs to connect to multiple Redis services synchronously. , that is, the pressure on the application server increases.
(2)如图2所示，采用Redis备份机制，实现一对多数据同步，针对一个主Redis服务器，其他从Redis服务器通过同步主服务器缓存数据，实现缓存数据的同步，这种方式的缺点是：主服务器在更新缓存的时候，还需要处理从Redis服务器的数据同步的请求，也即主Redis服务器的压力增大。(2) As shown in Figure 2, the Redis backup mechanism is used to realize one-to-many data synchronization. For one master Redis server, other slave Redis servers synchronize the cache data of the master server to realize the synchronization of cached data. The disadvantage of this method is that : When the main server updates the cache, it also needs to process the data synchronization request from the Redis server, that is, the pressure on the main Redis server increases.
(3)如图3所示，加入多个主Redis服务器，此时同步到从Redis服务器的压力减小，但是不能保证各主Redis服务器缓存数据的一致性。(3) As shown in Figure 3, adding multiple master Redis servers reduces the pressure of synchronization to slave Redis servers, but cannot guarantee the consistency of data cached by each master Redis server.
因此，在进行缓存数据同步时，减轻应用服务器和主服务器的压力，并实现缓存数据一致性是本领域亟待解决的问题Therefore, when synchronizing cached data, reducing the pressure on the application server and the main server and realizing cached data consistency is an urgent problem to be solved in this field.
发明内容SUMMARY OF THE INVENTION
有鉴于此，本发明的目的在于提供一种缓存数据同步方法、装置、设备及介质，能够解决一个主服务器连接多个从服务器时，主服务器压力大的问题，并且保证缓存数据的一致性，其具体方案如下：In view of this, the purpose of the present invention is to provide a cache data synchronization method, device, equipment and medium, which can solve the problem of high pressure on the master server when a master server is connected to multiple slave servers, and ensure the consistency of cache data, Its specific plan is as follows:
第一方面，本申请公开了一种缓存数据同步方法，应用于分布式消息中间件系统，包括：In a first aspect, the present application discloses a cache data synchronization method, which is applied to a distributed message middleware system, including:
获取远程字典服务集群的主服务器中的目标缓存数据；所述目标缓存数据为应用服务器在业务数据发生变更后将相应的变更后业务数据保存至所述主服务器后得到的缓存数据；Obtain the target cache data in the main server of the remote dictionary service cluster; the target cache data is the cache data obtained after the application server saves the corresponding changed business data to the main server after the business data is changed;
通过所述分布式消息中间件系统的服务端将所述目标缓存数据广播至所述分布式消息中间件系统的各客户端；不同的所述客户端分别对应于所述远程字典服务集群中不同的从服务器；The target cache data is broadcast to each client of the distributed message middleware system through the server of the distributed message middleware system; different clients correspond to different ones in the remote dictionary service cluster. the slave server;
控制所述分布式消息中间件系统的每个所述客户端将各自获取到的所述目标缓存数据分别传输至相应的所述从服务器，以便每台所述从服务器将各自获取到的所述目标缓存数据保存至各自的本地缓存空间。Controlling each of the clients of the distributed message middleware system to transmit the respectively acquired target cache data to the corresponding slave servers, so that each of the slave servers transmits the acquired The target cache data is saved to its own local cache space.
可选的，所述获取远程字典服务集群的主服务器中的目标缓存数据，包括：Optionally, obtaining the target cache data in the main server of the remote dictionary service cluster includes:
读取远程字典服务集群的主服务器中的缓存数据文件，并通过数据文件转换器对读取到的所述缓存数据文件进行文件转换处理，以得到所述目标缓存数据。Read the cache data file in the main server of the remote dictionary service cluster, and perform file conversion processing on the read cache data file through a data file converter to obtain the target cache data.
可选的，所述读取远程字典服务集群的主服务器中的缓存数据文件，包括：Optionally, the reading of the cached data files in the main server of the remote dictionary service cluster includes:
读取远程字典服务集群的主服务器中的RDB文件，并在读取到所述RDB文件后读取所述主服务器中的AOF文件。Read the RDB file in the master server of the remote dictionary service cluster, and read the AOF file in the master server after reading the RDB file.
可选的，所述读取远程字典服务集群的主服务器中的RDB文件，并在读取到所述RDB文件后读取所述主服务器中的AOF文件，包括：Optionally, the RDB file in the main server of the remote dictionary service cluster is read, and after the RDB file is read, the AOF file in the main server is read, including:
基于预设时间周期，定期读取远程字典服务集群的主服务器中的RDB文件，并在读取到所述RDB文件后读取所述主服务器中的AOF文件。Based on a preset time period, the RDB file in the main server of the remote dictionary service cluster is periodically read, and after the RDB file is read, the AOF file in the main server is read.
可选的，所述通过数据文件转换器对读取到的所述缓存数据文件进行文件转换处理，以得到所述目标缓存数据，包括：Optionally, performing file conversion processing on the read cache data file through a data file converter to obtain the target cache data, including:
通过所述数据文件转换器，对读取到的所述RDB文件和所述AOF文件分别进行解析得到相应的第一解析后数据和第二解析后数据，并以键值对作为数据记录方式对所述第一解析后数据和所述第二解析后数据进行重新封装，以得到所述目标缓存数据。Through the data file converter, the read RDB file and the AOF file are respectively parsed to obtain the corresponding first parsed data and second parsed data, and a key-value pair is used as a data record. The first parsed data and the second parsed data are repackaged to obtain the target cached data.
可选的，所述缓存数据同步方法，还包括：Optionally, the cached data synchronization method further includes:
在读取所述主服务器中的AOF文件之后，记录相应的AOF文件的读取位置。After reading the AOF file in the master server, record the reading position of the corresponding AOF file.
可选的，所述通过所述分布式消息中间件系统的服务端将所述目标缓存数据广播至所述分布式消息中间件系统的各客户端之前，还包括：Optionally, before the server of the distributed message middleware system broadcasts the target cache data to each client of the distributed message middleware system, the method further includes:
通过所述分布式消息中间件系统的服务端为所述目标缓存数据设置一个消息主题，并为所述消息主题配置一个消息队列，然后将所述目标缓存数据以消息的形式保存至所述消息队列；Set a message topic for the target cache data through the server of the distributed message middleware system, configure a message queue for the message topic, and then save the target cache data to the message in the form of a message queue;
相应的，所述通过所述分布式消息中间件系统的服务端将所述目标缓存数据广播至所述分布式消息中间件系统的各客户端，包括：Correspondingly, broadcasting the target cache data to each client of the distributed message middleware system through the server of the distributed message middleware system includes:
通过所述分布式消息中间件系统的服务端，获取每个客户端针对所述消息主题的订阅请求，然后将所述消息队列中保存的所述目标缓存数据广播至所述分布式消息中间件系统的各客户端。Obtain the subscription request of each client for the message topic through the server of the distributed message middleware system, and then broadcast the target cache data saved in the message queue to the distributed message middleware each client of the system.
第二方面，本申请公开了一种缓存数据同步装置，应用于分布式消息中间件系统，包括：In a second aspect, the present application discloses a cache data synchronization device, which is applied to a distributed message middleware system, including:
数据获取模块，用于获取远程字典服务集群的主服务器中的目标缓存数据；所述目标缓存数据为应用服务器在业务数据发生变更后将相应的变更后业务数据保存至所述主服务器后得到的缓存数据；The data acquisition module is used to acquire the target cache data in the main server of the remote dictionary service cluster; the target cache data is obtained after the application server saves the corresponding changed business data to the main server after the business data is changed. cache data;
数据广播模块，用于通过所述分布式消息中间件系统的服务端将所述目标缓存数据广播至所述分布式消息中间件系统的各客户端；不同的所述客户端分别对应于所述远程字典服务集群中不同的从服务器；a data broadcasting module, configured to broadcast the target cache data to each client of the distributed message middleware system through the server of the distributed message middleware system; different clients correspond to the Different slave servers in the remote dictionary service cluster;
数据发送模块，用于控制所述分布式消息中间件系统的每个所述客户端将各自获取到的所述目标缓存数据分别传输至相应的所述从服务器，以便每台所述从服务器将各自获取到的所述目标缓存数据保存至各自的本地缓存空间。A data sending module is used to control each client of the distributed message middleware system to transmit the respectively acquired target cache data to the corresponding slave server, so that each slave server sends the data to the corresponding slave server. The target cache data obtained by each is stored in the respective local cache space.
第三方面，本申请公开了一种电子设备，包括：In a third aspect, the present application discloses an electronic device, comprising:
存储器，用于保存计算机程序；memory for storing computer programs;
处理器，用于执行所述计算机程序，以实现前述公开的缓存数据同步方法。The processor is configured to execute the computer program to implement the cache data synchronization method disclosed above.
第四方面，本申请公开了一种计算机可读存储介质，用于保存计算机程序；其中，所述计算机程序被处理器执行时实现前述公开的缓存数据同步方法。In a fourth aspect, the present application discloses a computer-readable storage medium for storing a computer program; wherein, when the computer program is executed by a processor, the aforementioned method for synchronizing cached data is implemented.
可见，本申请提出一种缓存数据同步方法，包括：获取远程字典服务集群的主服务器中的目标缓存数据；所述目标缓存数据为应用服务器在业务数据发生变更后将相应的变更后业务数据保存至所述主服务器后得到的缓存数据；通过所述分布式消息中间件系统的服务端将所述目标缓存数据广播至所述分布式消息中间件系统的各客户端；不同的所述客户端分别对应于所述远程字典服务集群中不同的从服务器；控制所述分布式消息中间件系统的每个所述客户端将各自获取到的所述目标缓存数据分别传输至相应的所述从服务器，以便每台所述从服务器将各自获取到的所述目标缓存数据保存至各自的本地缓存空间，如此一来，本申请中的应用服务器只连接一个主服务器，因此减轻了应用服务器的压力。此外，本申请在主从服务器之间加入了分布式消息中间件系统，并利用分布式消息中间件系统来处理从服务器的数据同步请求，从而减轻了主服务器的压力。最后，具有广播发送的机制并且只有一个主服务器实现了缓存数据的实时同步，保证了从服务器上的数据的一致性。It can be seen that the present application proposes a method for synchronizing cached data, including: acquiring target cached data in a main server of a remote dictionary service cluster; the target cached data is that the application server saves the corresponding changed business data after the business data is changed The cached data obtained after reaching the main server; the target cached data is broadcast to each client of the distributed message middleware system through the server of the distributed message middleware system; the different clients respectively correspond to different slave servers in the remote dictionary service cluster; each of the clients controlling the distributed message middleware system transmits the respectively acquired target cache data to the corresponding slave servers , so that each of the slave servers saves the acquired target cache data in their respective local cache spaces. In this way, the application server in this application is only connected to one master server, thus reducing the pressure on the application server. In addition, the present application adds a distributed message middleware system between the master and slave servers, and uses the distributed message middleware system to process data synchronization requests from the slave servers, thereby reducing the pressure on the master server. Finally, there is a mechanism for broadcast transmission and only one master server realizes real-time synchronization of cached data, ensuring the consistency of data on slave servers.
附图说明Description of drawings
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据提供的附图获得其他的附图。In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only It is an embodiment of the present invention. For those of ordinary skill in the art, other drawings can also be obtained according to the provided drawings without creative work.
图1为第一种现有的缓存数据同步方法示意图；1 is a schematic diagram of a first existing cache data synchronization method;
图2为第二种现有的缓存数据同步方法示意图；Fig. 2 is the schematic diagram of the second existing cache data synchronization method;
图3为第三种现有的缓存数据同步方法示意图；3 is a schematic diagram of a third existing cache data synchronization method;
图4为本申请公开的一种缓存数据同步方法流程图；FIG. 4 is a flowchart of a cache data synchronization method disclosed in the present application;
图5为本申请公开的一种具体的缓存数据同步方法流程图；5 is a flowchart of a specific cache data synchronization method disclosed in the application;
图6为本申请公开的一种具体的缓存数据同步方法结构示意图；6 is a schematic structural diagram of a specific cache data synchronization method disclosed in the application;
图7为本申请公开的一种缓存数据同步装置结构示意图；7 is a schematic structural diagram of a cache data synchronization device disclosed in the present application;
图8为本申请公开的一种电子设备结构图。FIG. 8 is a structural diagram of an electronic device disclosed in this application.
具体实施方式Detailed ways
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.
在进行缓存数据同步时，现有技术面临应用服务器和主服务器的压力大，并且不能保证缓存数据一致性的问题。为此，本申请实施例提出一种缓存数据同步方案，能够减轻应用服务器和主服务器的压力，并实现缓存数据一致性。When synchronizing the cached data, the prior art faces the problem that the application server and the main server are under great pressure, and the consistency of the cached data cannot be guaranteed. To this end, an embodiment of the present application proposes a cache data synchronization scheme, which can reduce the pressure on the application server and the main server, and achieve cache data consistency.
本申请实施例公开了一种缓存数据同步方法，参见图4所示，该方法包括：The embodiment of the present application discloses a cache data synchronization method, as shown in FIG. 4 , the method includes:
步骤S11：获取远程字典服务集群的主服务器中的目标缓存数据；所述目标缓存数据为应用服务器在业务数据发生变更后将相应的变更后业务数据保存至所述主服务器后得到的缓存数据。Step S11: Acquire the target cache data in the main server of the remote dictionary service cluster; the target cache data is the cache data obtained after the application server saves the corresponding changed business data to the main server after the business data is changed.
本实施中的远程字典服务(Redis)，是一个完全开源的、遵守BSD(BerkeleySoftware Distribution，伯克利软件发行版)协议并且高性能的键值对(Key-Value)数据库，用来存储缓存数据。需要指出的是，应用层面会进行数据的更新，得到缓存数据，将缓存数据传输至远程字典服务集群的主服务器中，远程字典服务器能够将内存中的缓存持久化到磁盘上，进行持久化保存。所以分布式消息中间件系统在进行缓存数据同步时，首先需要获取远程字典服务集群的主服务器中的目标缓存数据，可以理解的是，获取到的目标缓存数据是会根据实际场景而产生变更的，所以，所述目标缓存数据为应用服务器在业务数据发生变更后将相应的变更后业务数据保存至所述主服务器后得到的缓存数据。The Remote Dictionary Service (Redis) in this implementation is a completely open source, BSD (Berkeley Software Distribution, Berkeley Software Distribution) protocol and high-performance Key-Value database for storing cached data. It should be pointed out that the application layer will update the data, obtain the cached data, and transmit the cached data to the main server of the remote dictionary service cluster. The remote dictionary server can persist the in-memory cache to the disk for persistent storage. . Therefore, when the distributed message middleware system synchronizes cache data, it first needs to obtain the target cache data in the main server of the remote dictionary service cluster. It is understandable that the obtained target cache data will be changed according to the actual scene. Therefore, the target cached data is cached data obtained after the application server saves the corresponding changed service data to the main server after the service data is changed.
具体的，在远程字典服务器进行持久化保存的过程中，首先需要在远程字典服务集群的主服务器中配置文件，利用redis.conf进行配置，开启远程字典服务的持久化功能，其格式如下：Specifically, in the process of persisting the remote dictionary server, you first need to configure the file in the main server of the remote dictionary service cluster, use redis.conf to configure, and enable the persistence function of the remote dictionary service. The format is as follows:
RDB持久化配置：RDB persistence configuration:
save 900 1save 900 1
save 300 10save 300 10
save 60 10000；save 60 10000;
AOF持久化配置：AOF persistence configuration:
appendfsync always#每次有数据修改发生时都会写入AOF文件。appendfsync always#The AOF file will be written every time a data modification occurs.
需要指出的是，在分布式消息中间件系统中加入了远程字典服务数据转换器，因为远程字典服务器保存的数据文件有两种方式：一种是RDB(Redis Database)文件，定时将缓存数据导出到RDB文件中；另一种是AOF(Append Only File)文件，将远程字典服务的操作日志以追加的方式写入文件；所以在获取远程字典服务集群的主服务器中的目标缓存数据的过程中，首先要利用分布式消息中间件系统中的远程字典服务数据转换器对读取到的远程字典服务集群的主服务器中的缓存数据文件进行文件转换处理，数据转换器将RDB文件或者AOF文件进行数据解析，得到相应的第一解析后数据和第二解析后数据，然后以键值对(key-value)作为数据记录方式对第一解析后数据和第二解析后数据进行重新封装，以得到目标缓存数据。It should be pointed out that the remote dictionary service data converter is added to the distributed message middleware system, because the data files saved by the remote dictionary server have two ways: one is the RDB (Redis Database) file, which regularly exports the cached data into the RDB file; the other is the AOF (Append Only File) file, which writes the operation log of the remote dictionary service to the file in an appending manner; so in the process of obtaining the target cache data in the master server of the remote dictionary service cluster , First, use the remote dictionary service data converter in the distributed message middleware system to perform file conversion processing on the read cache data files in the main server of the remote dictionary service cluster. The data converter converts the RDB file or AOF file into Data parsing to obtain the corresponding first parsed data and second parsed data, and then re-encapsulate the first parsed data and the second parsed data by using key-value pairs as data records to obtain Target cache data.
本申请实施例中，对于分布式消息中间件系统中的远程字典服务数据转换器会进行定时配置，这样数据转换器则会基于预设时间周期，定期读取远程字典服务集群的主服务器中最新的RDB文件，并在读取到RDB文件后读取主服务器中的AOF文件。可以理解的是，在进行AOF文件持久化配置的时候，一旦缓存区的内容发生了变化，就将其写入到AOF文件中，当读取到RDB文件后实现了远程字典服务的全量同步，在应用层面缓存有更新的时候，再读取主服务器中的AOF文件，实现了远程字典服务的增量同步，可以进一步提高传输数据的速度和数据同步的效率。需要指出的是，在读取所述主服务器中的AOF文件之后，要随时记录相应的AOF文件的读取位置。In the embodiment of the present application, the remote dictionary service data converter in the distributed message middleware system will be configured regularly, so that the data converter will periodically read the latest data from the main server of the remote dictionary service cluster based on a preset time period. the RDB file, and read the AOF file in the master server after reading the RDB file. It is understandable that when the AOF file persistence configuration is performed, once the content of the cache area changes, it will be written to the AOF file. When the RDB file is read, the full synchronization of the remote dictionary service is realized. When the cache at the application level is updated, the AOF file in the main server is read again to realize the incremental synchronization of the remote dictionary service, which can further improve the speed of data transmission and the efficiency of data synchronization. It should be pointed out that after reading the AOF file in the main server, the reading position of the corresponding AOF file should be recorded at any time.
步骤S12：通过所述分布式消息中间件系统的服务端将所述目标缓存数据广播至所述分布式消息中间件系统的各客户端；不同的所述客户端分别对应于所述远程字典服务集群中不同的从服务器。Step S12: Broadcast the target cache data to each client of the distributed message middleware system through the server of the distributed message middleware system; different clients respectively correspond to the remote dictionary service Different slave servers in the cluster.
本实施例中，在Redis主服务器以及从服务器之间加入了分布式消息中间件以进行数据广播。具体的，在获取到所述目标缓存数据后，将所述目标缓存数据发送至分布式消息中间件系统的服务端，然后由所述分布式消息中间件系统的服务端将所述目标缓存数据广播至所述分布式消息中间件系统的各客户端，并且只有注册在所述分布式消息中间件服务端的所述分布式消息中间件系统的各客户端才能够接收到所述目标缓存数据。本申请中，通过广播发送的方式实现了从服务器接收数据的一致性。需要注意的是，为了将所述目标缓存数据发送至分布式消息中间件系统的服务端，在数据转换器中部署了一个客户端。In this embodiment, distributed message middleware is added between the Redis master server and the slave server for data broadcasting. Specifically, after acquiring the target cache data, the target cache data is sent to the server of the distributed message middleware system, and then the server of the distributed message middleware system sends the target cache data broadcast to each client of the distributed message middleware system, and only each client of the distributed message middleware system registered on the distributed message middleware server can receive the target cache data. In the present application, the consistency of data received from the server is realized by means of broadcast transmission. It should be noted that, in order to send the target cache data to the server of the distributed message middleware system, a client is deployed in the data converter.
本实施例中，为所述主服务器建立了多个从服务器节点，并且设定好不同的所述客户端分别对应于所述远程字典服务集群中不同的从服务器，也即，每个所述从服务器节点对应一个所述分布式消息中间件系统的客户端。In this embodiment, multiple slave server nodes are established for the master server, and different clients are set to correspond to different slave servers in the remote dictionary service cluster, that is, each of the The slave server node corresponds to a client of the distributed message middleware system.
步骤S13：控制所述分布式消息中间件系统的每个所述客户端将各自获取到的所述目标缓存数据分别传输至相应的所述从服务器，以便每台所述从服务器将各自获取到的所述目标缓存数据保存至各自的本地缓存空间。Step S13: Control each of the clients of the distributed message middleware system to transmit the respectively obtained target cache data to the corresponding slave servers, so that each of the slave servers will obtain the The target cache data is saved to the respective local cache space.
本实施例中，由于不同的所述客户端分别对应于所述远程字典服务集群中不同的从服务器，因此所述分布式消息中间件系统控制所述分布式消息中间件系统的每个所述客户端将各自获取到的所述目标缓存数据分别传输至相应的所述从服务器，以便每台所述从服务器将各自获取到的所述目标缓存数据保存至各自的本地缓存空间。In this embodiment, since different clients correspond to different slave servers in the remote dictionary service cluster, the distributed message middleware system controls each of the distributed message middleware systems. The client transmits the respectively obtained target cache data to the corresponding slave servers, so that each of the slave servers saves the respectively obtained target cache data to its own local cache space.
可见，本申请提出一种缓存数据同步方法，包括：获取远程字典服务集群的主服务器中的目标缓存数据；所述目标缓存数据为应用服务器在业务数据发生变更后将相应的变更后业务数据保存至所述主服务器后得到的缓存数据；通过所述分布式消息中间件系统的服务端将所述目标缓存数据广播至所述分布式消息中间件系统的各客户端；不同的所述客户端分别对应于所述远程字典服务集群中不同的从服务器；控制所述分布式消息中间件系统的每个所述客户端将各自获取到的所述目标缓存数据分别传输至相应的所述从服务器，以便每台所述从服务器将各自获取到的所述目标缓存数据保存至各自的本地缓存空间，如此一来，本申请中的应用服务器只连接一个主服务器，因此减轻了应用服务器的压力。此外，本申请在主从服务器之间加入了分布式消息中间件系统，并利用分布式消息中间件系统来处理从服务器的数据同步请求，从而减轻了主服务器的压力。最后，具有广播发送的机制并且只有一个主服务器实现了缓存数据的实时同步，保证了从服务器上的数据的一致性。It can be seen that the present application proposes a method for synchronizing cached data, including: acquiring target cached data in a main server of a remote dictionary service cluster; the target cached data is that the application server saves the corresponding changed business data after the business data is changed The cached data obtained after reaching the main server; the target cached data is broadcast to each client of the distributed message middleware system through the server of the distributed message middleware system; the different clients respectively correspond to different slave servers in the remote dictionary service cluster; each of the clients controlling the distributed message middleware system transmits the respectively acquired target cache data to the corresponding slave servers , so that each of the slave servers saves the acquired target cache data in their respective local cache spaces. In this way, the application server in this application is only connected to one master server, thus reducing the pressure on the application server. In addition, the present application adds a distributed message middleware system between the master and slave servers, and uses the distributed message middleware system to process data synchronization requests from the slave servers, thereby reducing the pressure on the master server. Finally, there is a mechanism for broadcast transmission and only one master server realizes real-time synchronization of cached data, ensuring the consistency of data on slave servers.
本申请实施例公开了一种具体的缓存数据同步方法，参见图5所示，该方法包括：The embodiment of the present application discloses a specific cache data synchronization method, as shown in FIG. 5 , the method includes:
步骤S21：获取远程字典服务集群的主服务器中的目标缓存数据；所述目标缓存数据为应用服务器在业务数据发生变更后将相应的变更后业务数据保存至所述主服务器后得到的缓存数据。Step S21: Acquire the target cache data in the main server of the remote dictionary service cluster; the target cache data is the cache data obtained after the application server saves the corresponding changed business data to the main server after the business data is changed.
其中，关于上述步骤S21更加具体的处理过程可以参考前述实施例中公开的相应内容，在此不再进行赘述。For more specific processing procedures of the above-mentioned step S21, reference may be made to the corresponding content disclosed in the foregoing embodiments, which will not be repeated here.
步骤S22：通过所述分布式消息中间件系统的服务端为所述目标缓存数据设置一个消息主题，并为所述消息主题配置一个消息队列，然后将所述目标缓存数据以消息的形式保存至所述消息队列。Step S22: Set a message topic for the target cache data through the server of the distributed message middleware system, and configure a message queue for the message topic, and then save the target cache data in the form of messages to the message queue.
本申请实施例中，在获取到远程字典服务集群的主服务器中的目标缓存数据后，需要对分布式消息中间件系统的服务端进行集群部署，然后广播数据。具体的，在分布式消息中间件系统的服务端为目标缓存数据设置一个消息主题，并为所述消息主题配置一个消息队列，然后将所述目标缓存数据以消息的形式保存至所述消息队列，以供分布式消息中间件集群中对应的每个客户端获取目标缓存数据，并将所述目标缓存数据广播到注册在其相应的分布式消息中间件客户端的远程字典服务集群的从服务器上。In the embodiment of the present application, after acquiring the target cache data in the main server of the remote dictionary service cluster, it is necessary to perform cluster deployment on the server of the distributed message middleware system, and then broadcast the data. Specifically, a message topic is set for the target cache data on the server side of the distributed message middleware system, and a message queue is configured for the message topic, and then the target cache data is saved to the message queue in the form of a message , so that each client corresponding to the distributed message middleware cluster obtains the target cache data, and broadcasts the target cache data to the slave server of the remote dictionary service cluster registered with its corresponding distributed message middleware client .
可以理解的是，因为每个队列中消息顺序一定，发送数据的时候有先后顺序，设置为一个消息主题，并将该主题设置成只有一个队列，这样还原的时候也会基于发送数据时的顺序，可以保证备份数据的顺序一致性。It is understandable that because the order of messages in each queue is certain, there is an order when sending data, set it as a message topic, and set the topic to have only one queue, so that the restoration will also be based on the order of sending data. , which can guarantee the sequential consistency of backup data.
步骤S23：通过所述分布式消息中间件系统的服务端，获取每个客户端针对所述消息主题的订阅请求，然后将所述消息队列中保存的所述目标缓存数据广播至所述分布式消息中间件系统的各客户端。Step S23: Obtain the subscription request of each client for the message topic through the server of the distributed message middleware system, and then broadcast the target cache data saved in the message queue to the distributed message Each client of the message middleware system.
本实施例中，当所述分布式消息中间件的各客户端需要所述目标缓存数据时，所述分布式消息中间件的各客户端向所述分布式消息中间件系统的服务端发送所述目标缓存数据对应的所述消息主题的订阅请求，所述分布式消息中间件系统的服务端获取到每个客户端针对所述消息主题的订阅请求后，将所述消息队列中保存的所述目标缓存数据广播至所述分布式消息中间件系统的各客户端。In this embodiment, when each client of the distributed message middleware needs the target cache data, each client of the distributed message middleware sends the data to the server of the distributed message middleware system. A subscription request for the message topic corresponding to the target cache data, after the server of the distributed message middleware system obtains the subscription request for the message topic from each client, it stores all the messages stored in the message queue. The target cache data is broadcast to each client of the distributed message middleware system.
步骤S24：控制所述分布式消息中间件系统的每个所述客户端将各自获取到的所述目标缓存数据分别传输至相应的所述从服务器，以便每台所述从服务器将各自获取到的所述目标缓存数据保存至各自的本地缓存空间。Step S24: Control each of the clients of the distributed message middleware system to transmit the respectively obtained target cache data to the corresponding slave servers, so that each of the slave servers will obtain the The target cache data is saved to the respective local cache space.
本实施例中，所述分布式消息中间件系统的每个所述客户端将各自获取到的所述目标缓存数据分别传输至相应的所述从服务器中，需要注意的是，所述目标缓存数据在所述消息队列中以消息形式进行存储，因此所述从服务器获取到的所述目标缓存数据仍然是消息形式，进一步的需要将消息形式的所述目标缓存数据进行解析，以便每台所述从服务器将各自获取到的所述目标缓存数据保存至各自的本地缓存空间，从而实现缓存数据的同步。In this embodiment, each client of the distributed message middleware system transmits the respectively acquired target cache data to the corresponding slave server. It should be noted that the target cache The data is stored in the form of messages in the message queue, so the target cache data obtained from the server is still in the form of messages. Further, the target cache data in the form of messages needs to be parsed, so that each The slave server saves the target cache data obtained by each of them in their respective local cache spaces, so as to realize the synchronization of the cache data.
可见，本申请实施例提供了一种缓存数据同步的方法，首先通过获取远程字典服务集群的主服务器中的目标缓存数据；所述目标缓存数据为应用服务器在业务数据发生变更后将相应的变更后业务数据保存至所述主服务器后得到的缓存数据；再通过所述分布式消息中间件系统的服务端为所述目标缓存数据设置一个消息主题，并为所述消息主题配置一个消息队列，然后将所述目标缓存数据以消息的形式保存至所述消息队列；通过所述分布式消息中间件系统的服务端，获取每个客户端针对所述消息主题的订阅请求，然后将所述消息队列中保存的所述目标缓存数据广播至所述分布式消息中间件系统的各客户端；最后控制所述分布式消息中间件系统的每个所述客户端将各自获取到的所述目标缓存数据分别传输至相应的所述从服务器，以便每台所述从服务器将各自获取到的所述目标缓存数据保存至各自的本地缓存空间。可见，通过分布式消息中间件系统的服务端的广播通知机制将目标缓存数据广播至分布式消息中间件系统的各客户端，并为服务端设置一个消息的主题，将该主题设置成只有一个队列，保证了备份数据的顺序一致性。并且，由于本申请中的应用服务器只连接一个主服务器，因此减轻了应用服务器的压力。此外，本申请在主从服务器之间加入了分布式消息中间件系统，并利用分布式消息中间件系统来处理从服务器的数据同步请求，从而减轻了主服务器的压力。最后，具有广播发送的机制并且只有一个主服务器实现了缓存数据的实时同步，保证了从服务器上的数据的一致性。It can be seen that the embodiment of the present application provides a method for synchronizing cached data. First, the target cached data in the main server of the remote dictionary service cluster is obtained; The cache data obtained after the business data is saved to the main server; and then a message topic is set for the target cache data through the server of the distributed message middleware system, and a message queue is configured for the message topic, Then save the target cache data to the message queue in the form of a message; obtain the subscription request of each client for the message topic through the server of the distributed message middleware system, and then store the message The target cache data saved in the queue is broadcast to each client of the distributed message middleware system; finally, each of the clients of the distributed message middleware system is controlled to send the respectively obtained target cache The data are respectively transmitted to the corresponding slave servers, so that each of the slave servers saves the respective acquired target cache data to their respective local cache spaces. It can be seen that the target cache data is broadcast to each client of the distributed message middleware system through the broadcast notification mechanism of the server side of the distributed message middleware system, and a message topic is set for the server side, and the topic is set to have only one queue. , which ensures the sequential consistency of backup data. Moreover, since the application server in the present application is only connected to one main server, the pressure on the application server is relieved. In addition, the present application adds a distributed message middleware system between the master and slave servers, and uses the distributed message middleware system to process data synchronization requests from the slave servers, thereby reducing the pressure on the master server. Finally, there is a mechanism for broadcast transmission and only one master server realizes real-time synchronization of cached data, ensuring the consistency of data on slave servers.
图6给出了关于缓存数据同步方法的具体过程的结构示意图。FIG. 6 is a schematic structural diagram of the specific process of the cache data synchronization method.
需要指出的是，本实施例在数据文件转换器中部署了RocketMQ客户端，用来将经过数据文件转换器转换后得到的所述目标缓存数据发送给所述分布式消息中间件系统的RocketMQ服务端。参见图6所示，本实施例中的应用服务器在业务数据发生变更后将相应的变更后业务数据保存至所述主Redis服务器，在主Redis服务器中，缓存数据经过配置后得到RDB文件和AOF文件，然后经数据文件转换器对读取到的RDB文件和AOF文件进行文件转换处理，得到目标缓存数据，并由数据文件转换器中预先部署的RocketMQ客户端将所述目标缓存数据发送给所述分布式消息中间件系统的RocketMQ服务端。需要指出的是，所述目标缓存数据是以消息的形式保存在所述分布式消息中间件系统的RocketMQ服务端中的消息队列中的，并且所述目标缓存数据对应一个消息主题，因此基于每个RocketMQ客户端订阅的所述消息主题，所述分布式消息中间件系统的RocketMQ服务端会将所述消息队列中保存的所述目标缓存数据广播至所述分布式消息中间件系统的各RocketMQ客户端，最后所述分布式消息中间件系统控制所述分布式消息中间件系统的每个所述RocketMQ客户端将各自获取到的所述目标缓存数据分别传输至相应的所述从Redis服务器，以便每台所述从Redis服务器将各自获取到的所述目标缓存数据保存至各自的本地缓存空间。It should be pointed out that in this embodiment, a RocketMQ client is deployed in the data file converter to send the target cache data obtained after conversion by the data file converter to the RocketMQ service of the distributed message middleware system end. Referring to FIG. 6 , the application server in this embodiment saves the corresponding changed business data to the main Redis server after the business data is changed. In the main Redis server, the cached data is configured to obtain an RDB file and an AOF file, and then perform file conversion processing on the read RDB file and AOF file through the data file converter to obtain the target cache data, and the RocketMQ client pre-deployed in the data file converter sends the target cache data to the Describe the RocketMQ server of the distributed message middleware system. It should be pointed out that the target cache data is stored in the message queue in the RocketMQ server of the distributed message middleware system in the form of messages, and the target cache data corresponds to a message topic, so based on each The message topic subscribed by each RocketMQ client, the RocketMQ server of the distributed message middleware system will broadcast the target cache data saved in the message queue to each RocketMQ of the distributed message middleware system Client, finally, the distributed message middleware system controls each RocketMQ client of the distributed message middleware system to transmit the respectively acquired target cache data to the corresponding slave Redis server, So that each of the slave Redis servers saves the target cache data obtained by each of them in their own local cache space.
相应的，本申请实施例还公开了一种缓存数据同步装置，参见图7所示，该装置包括：Correspondingly, the embodiment of the present application also discloses a cache data synchronization device, as shown in FIG. 7 , the device includes:
数据获取模块11：获取远程字典服务集群的主服务器中的目标缓存数据；所述目标缓存数据为应用服务器在业务数据发生变更后将相应的变更后业务数据保存至所述主服务器后得到的缓存数据；Data acquisition module 11: acquires the target cache data in the main server of the remote dictionary service cluster; the target cache data is the cache obtained after the application server saves the corresponding changed business data to the main server after the business data is changed data;
数据广播模块12：通过所述分布式消息中间件系统的服务端将所述目标缓存数据广播至所述分布式消息中间件系统的各客户端；不同的所述客户端分别对应于所述远程字典服务集群中不同的从服务器；Data broadcasting module 12: broadcast the target cache data to each client of the distributed message middleware system through the server of the distributed message middleware system; different clients correspond to the remote Different slave servers in the dictionary service cluster;
数据发送模块13：控制所述分布式消息中间件系统的每个所述客户端将各自获取到的所述目标缓存数据分别传输至相应的所述从服务器，以便每台所述从服务器将各自获取到的所述目标缓存数据保存至各自的本地缓存空间。Data sending module 13: Control each of the clients of the distributed message middleware system to transmit the respectively acquired target cache data to the corresponding slave servers, so that each of the slave servers sends their respective The acquired target cache data is stored in the respective local cache spaces.
其中，关于上述各个模块更加具体的工作过程可以参考前述实施例中公开的相应内容，在此不再进行赘述。For more specific working processes of the above-mentioned modules, reference may be made to the corresponding contents disclosed in the foregoing embodiments, which will not be repeated here.
可见，本申请提出一种缓存数据同步方法，包括：获取远程字典服务集群的主服务器中的目标缓存数据；所述目标缓存数据为应用服务器在业务数据发生变更后将相应的变更后业务数据保存至所述主服务器后得到的缓存数据；通过所述分布式消息中间件系统的服务端将所述目标缓存数据广播至所述分布式消息中间件系统的各客户端；不同的所述客户端分别对应于所述远程字典服务集群中不同的从服务器；控制所述分布式消息中间件系统的每个所述客户端将各自获取到的所述目标缓存数据分别传输至相应的所述从服务器，以便每台所述从服务器将各自获取到的所述目标缓存数据保存至各自的本地缓存空间，如此一来，本申请中的应用服务器只连接一个主服务器，因此减轻了应用服务器的压力。此外，本申请在主从服务器之间加入了分布式消息中间件系统，并利用分布式消息中间件系统来处理从服务器的数据同步请求，从而减轻了主服务器的压力。最后，具有广播发送的机制并且只有一个主服务器实现了缓存数据的实时同步，保证了从服务器上的数据的一致性。It can be seen that the present application proposes a method for synchronizing cached data, including: acquiring target cached data in a main server of a remote dictionary service cluster; the target cached data is that the application server saves the corresponding changed business data after the business data is changed The cached data obtained after reaching the main server; the target cached data is broadcast to each client of the distributed message middleware system through the server of the distributed message middleware system; the different clients respectively correspond to different slave servers in the remote dictionary service cluster; each of the clients controlling the distributed message middleware system transmits the respectively acquired target cache data to the corresponding slave servers , so that each of the slave servers saves the acquired target cache data in their respective local cache spaces. In this way, the application server in this application is only connected to one master server, thus reducing the pressure on the application server. In addition, the present application adds a distributed message middleware system between the master and slave servers, and uses the distributed message middleware system to process data synchronization requests from the slave servers, thereby reducing the pressure on the master server. Finally, there is a mechanism for broadcast transmission and only one master server realizes real-time synchronization of cached data, ensuring the consistency of data on slave servers.
进一步的，本申请实施例还提供了一种电子设备。图8是根据一示例性实施例示出的电子设备20结构图，图中的内容不能认为是对本申请的使用范围的任何限制。Further, the embodiments of the present application also provide an electronic device. FIG. 8 is a structural diagram of an
图8为本申请实施例提供的一种电子设备20的结构示意图。该电子设备20，具体可以包括：至少一个处理器21、至少一个存储器22、显示屏23、输入输出接口24、通信接口25、电源26、和通信总线27。其中，所述存储器22用于存储计算机程序，所述计算机程序由所述处理器21加载并执行，以实现前述任一实施例公开的缓存数据同步方法中的相关步骤。另外，本实施例中的电子设备20具体可以为电子计算机。FIG. 8 is a schematic structural diagram of an
本实施例中，电源26用于为电子设备20上的各硬件设备提供工作电压；通信接口25能够为电子设备20创建与外界设备之间的数据传输通道，其所遵循的通信协议是能够适用于本申请技术方案的任意通信协议，在此不对其进行具体限定；输入输出接口24，用于获取外界输入数据或向外界输出数据，其具体的接口类型可以根据具体应用需要进行选取，在此不进行具体限定。In this embodiment, the power supply 26 is used to provide working voltage for each hardware device on the
另外，存储器22作为资源存储的载体，可以是只读存储器、随机存储器、磁盘或者光盘等，其上所存储的资源可以包括计算机程序221，存储方式可以是短暂存储或者永久存储。其中，计算机程序221除了包括能够用于完成前述任一实施例公开的由电子设备20执行的缓存数据同步方法的计算机程序之外，还可以进一步包括能够用于完成其他特定工作的计算机程序。In addition, the memory 22, as a resource storage carrier, can be a read-only memory, a random access memory, a magnetic disk or an optical disk, etc. The resources stored thereon can include a computer program 221, and the storage method can be short-term storage or permanent storage. The computer program 221 may further include a computer program that can be used to complete other specific tasks in addition to the computer program that can be used to complete the method for synchronizing cached data performed by the
进一步的，本申请实施例还公开了一种计算机可读存储介质，用于存储计算机程序；其中，所述计算机程序被处理器执行时实现前述公开的缓存数据同步方法。Further, an embodiment of the present application further discloses a computer-readable storage medium for storing a computer program; wherein, when the computer program is executed by a processor, the aforementioned method for synchronizing cached data is implemented.
关于该方法的具体步骤可以参考前述实施例中公开的相应内容，在此不再进行赘述。For the specific steps of the method, reference may be made to the corresponding content disclosed in the foregoing embodiments, which will not be repeated here.
本申请书中各个实施例采用递进的方式描述，每个实施例重点说明的都是与其它实施例的不同之处，各个实施例之间相同或相似部分互相参见即可。对于实施例公开的装置而言，由于其与实施例公开的方法相对应，所以描述的比较简单，相关之处参见方法部分说明即可。The various embodiments in this application are described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same or similar parts of the various embodiments may be referred to each other. As for the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant part can be referred to the description of the method.
专业人员还可以进一步意识到，结合本文中所公开的实施例描述的各示例的单元及算法步骤，能够以电子硬件、计算机软件或者二者的结合来实现，为了清楚地说明硬件和软件的可互换性，在上述说明中已经按照功能一般性地描述了各示例的组成及步骤。这些功能究竟以硬件还是软件方式来执行，取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能，但是这种实现不应认为超出本申请的范围。Professionals may further realize that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two, in order to clearly illustrate the possibilities of hardware and software. Interchangeability, the above description has generally described the components and steps of each example in terms of functionality. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of this application.
结合本文中所公开的实施例描述的方法或算法的步骤可以直接用硬件、处理器执行的软件模块，或者二者的结合来实施。软件模块可以置于随机存储器(RAM)、内存、只读存储器(ROM)、电可编程ROM、电可擦除可编程ROM、寄存器、硬盘、可移动磁盘、CD-ROM、或技术领域内所公知的任意其它形式的存储介质中。The steps of a method or algorithm described in conjunction with the embodiments disclosed herein may be directly implemented in hardware, a software module executed by a processor, or a combination of the two. A software module can be placed in random access memory (RAM), internal memory, read only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or any other in the technical field. in any other known form of storage medium.
最后，还需要说明的是，在本文中，诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来，而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。Finally, it should also be noted that in this document, relational terms such as first and second are used only to distinguish one entity or operation from another, and do not necessarily require or imply these entities or that there is any such actual relationship or sequence between operations. Moreover, the terms "comprising", "comprising" or any other variation thereof are intended to encompass a non-exclusive inclusion such that a process, method, article or device that includes a list of elements includes not only those elements, but also includes not explicitly listed or other elements inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in a process, method, article or apparatus that includes the element.
以上对本申请所提供的一种缓存数据同步方法、装置、设备、存储介质进行了详细介绍，本文中应用了具体个例对本申请的原理及实施方式进行了阐述，以上实施例的说明只是用于帮助理解本申请的方法及其核心思想；同时，对于本领域的一般技术人员，依据本申请的思想，在具体实施方式及应用范围上均会有改变之处，综上所述，本说明书内容不应理解为对本申请的限制。A method, device, device, and storage medium for synchronizing cached data provided by the present application have been described in detail above. The principles and implementations of the present application are described with specific examples. The descriptions of the above embodiments are only used for Help to understand the method of the present application and its core idea; meanwhile, for those of ordinary skill in the art, according to the idea of the present application, there will be changes in the specific implementation and application scope. In summary, the content of this specification It should not be construed as a limitation of this application.
Claims (10)
Translated fromChinesePriority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111445506.XACN114328618B (en) | 2021-11-30 | 2021-11-30 | A cache data synchronization method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111445506.XACN114328618B (en) | 2021-11-30 | 2021-11-30 | A cache data synchronization method, device, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114328618Atrue CN114328618A (en) | 2022-04-12 |
| CN114328618B CN114328618B (en) | 2024-02-09 |
Family
ID=81049265
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111445506.XAActiveCN114328618B (en) | 2021-11-30 | 2021-11-30 | A cache data synchronization method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114328618B (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114547511A (en)* | 2022-04-27 | 2022-05-27 | 成都瑞华康源科技有限公司 | System data dictionary using method and system based on Internet of things MQTT protocol |
| CN114675987A (en)* | 2022-04-18 | 2022-06-28 | 北京高途云集教育科技有限公司 | Cache data processing method and device, computer equipment and storage medium |
| CN114780643A (en)* | 2022-06-16 | 2022-07-22 | 恒生电子股份有限公司 | Data synchronization processing method and device, electronic equipment and readable storage medium |
| CN115118590A (en)* | 2022-06-22 | 2022-09-27 | 平安科技（深圳）有限公司 | Method, device, system, equipment and storage medium for managing configuration data |
| CN115412603A (en)* | 2022-11-02 | 2022-11-29 | 中国电子科技集团公司第十五研究所 | High-availability method and device for message client module of message middleware |
| CN115858582A (en)* | 2022-11-24 | 2023-03-28 | 杭州安恒车联网安全技术有限公司 | Cache real-time updating method, device, equipment and storage medium |
| CN115883087A (en)* | 2022-12-21 | 2023-03-31 | 中国建设银行股份有限公司 | Key updating method, device, equipment and medium based on server cluster |
| CN116010501A (en)* | 2022-12-30 | 2023-04-25 | 百果园技术(新加坡)有限公司 | Distributed medium-level data processing method, system, device, storage medium and program product |
| CN116112509A (en)* | 2022-12-29 | 2023-05-12 | 中国电信股份有限公司 | Data synchronization method and device, electronic equipment and storage medium |
| CN116938961A (en)* | 2023-09-15 | 2023-10-24 | 北京趋动智能科技有限公司 | System and method for data synchronization and data reading method |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110145499A1 (en)* | 2009-12-16 | 2011-06-16 | International Business Machines Corporation | Asynchronous file operations in a scalable multi-node file system cache for a remote cluster file system |
| CN105893543A (en)* | 2016-03-31 | 2016-08-24 | 微梦创科网络科技（中国）有限公司 | Data buffer service method and system |
| CN110633320A (en)* | 2018-05-30 | 2019-12-31 | 北京京东尚科信息技术有限公司 | Processing method, system, equipment and storage medium of distributed data service |
| CN113010549A (en)* | 2021-01-29 | 2021-06-22 | 腾讯科技（深圳）有限公司 | Data processing method based on remote multi-active system, related equipment and storage medium |
| CN113157466A (en)* | 2021-04-27 | 2021-07-23 | 上海销氪信息科技有限公司 | Message pushing method, device, system, electronic equipment and storage medium |
- 2021
- 2021-11-30CNCN202111445506.XApatent/CN114328618B/enactiveActive
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110145499A1 (en)* | 2009-12-16 | 2011-06-16 | International Business Machines Corporation | Asynchronous file operations in a scalable multi-node file system cache for a remote cluster file system |
| CN105893543A (en)* | 2016-03-31 | 2016-08-24 | 微梦创科网络科技（中国）有限公司 | Data buffer service method and system |
| CN110633320A (en)* | 2018-05-30 | 2019-12-31 | 北京京东尚科信息技术有限公司 | Processing method, system, equipment and storage medium of distributed data service |
| CN113010549A (en)* | 2021-01-29 | 2021-06-22 | 腾讯科技（深圳）有限公司 | Data processing method based on remote multi-active system, related equipment and storage medium |
| CN113157466A (en)* | 2021-04-27 | 2021-07-23 | 上海销氪信息科技有限公司 | Message pushing method, device, system, electronic equipment and storage medium |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114675987A (en)* | 2022-04-18 | 2022-06-28 | 北京高途云集教育科技有限公司 | Cache data processing method and device, computer equipment and storage medium |
| CN114547511A (en)* | 2022-04-27 | 2022-05-27 | 成都瑞华康源科技有限公司 | System data dictionary using method and system based on Internet of things MQTT protocol |
| CN114780643A (en)* | 2022-06-16 | 2022-07-22 | 恒生电子股份有限公司 | Data synchronization processing method and device, electronic equipment and readable storage medium |
| CN114780643B (en)* | 2022-06-16 | 2022-10-21 | 恒生电子股份有限公司 | Data synchronization processing method and device, electronic equipment and readable storage medium |
| CN115118590A (en)* | 2022-06-22 | 2022-09-27 | 平安科技（深圳）有限公司 | Method, device, system, equipment and storage medium for managing configuration data |
| CN115118590B (en)* | 2022-06-22 | 2024-05-10 | 平安科技（深圳）有限公司 | Method, device, system, equipment and storage medium for managing configuration data |
| CN115412603B (en)* | 2022-11-02 | 2022-12-27 | 中国电子科技集团公司第十五研究所 | High-availability method and device for message client module of message middleware |
| CN115412603A (en)* | 2022-11-02 | 2022-11-29 | 中国电子科技集团公司第十五研究所 | High-availability method and device for message client module of message middleware |
| CN115858582A (en)* | 2022-11-24 | 2023-03-28 | 杭州安恒车联网安全技术有限公司 | Cache real-time updating method, device, equipment and storage medium |
| CN115883087A (en)* | 2022-12-21 | 2023-03-31 | 中国建设银行股份有限公司 | Key updating method, device, equipment and medium based on server cluster |
| CN116112509A (en)* | 2022-12-29 | 2023-05-12 | 中国电信股份有限公司 | Data synchronization method and device, electronic equipment and storage medium |
| CN116010501A (en)* | 2022-12-30 | 2023-04-25 | 百果园技术(新加坡)有限公司 | Distributed medium-level data processing method, system, device, storage medium and program product |
| CN116938961A (en)* | 2023-09-15 | 2023-10-24 | 北京趋动智能科技有限公司 | System and method for data synchronization and data reading method |
| CN116938961B (en)* | 2023-09-15 | 2024-03-01 | 北京趋动智能科技有限公司 | System and method for data synchronization and data reading method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114328618B (en) | 2024-02-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114328618B (en) | A cache data synchronization method, device, equipment and storage medium | |
| US10764369B2 (en) | Data storage method and server applicable to distributed server cluster | |
| WO2021121370A1 (en) | Message loss detection method and apparatus for message queue | |
| CN112118315A (en) | Data processing system, method, apparatus, electronic device and storage medium | |
| US10069942B2 (en) | Method and apparatus for changing configurations | |
| CN107861686A (en) | File memory method, service end and computer-readable recording medium | |
| CN113347020B (en) | Domain name service disaster recovery method, system, device and medium | |
| JP2017037666A (en) | Send category information | |
| CN108200219A (en) | Method of data synchronization, device, server and storage medium | |
| CN105656653A (en) | Network access method of newly added node in distributed coordination system, device and system | |
| WO2012151993A1 (en) | Service pushing method and device | |
| CN114448686B (en) | Cross-network communication device and method based on micro-service | |
| CN113965620A (en) | Message pushing system based on MQTT and REDIS | |
| CN112069152B (en) | Database cluster upgrading method, device, equipment and storage medium | |
| CN110909059A (en) | Data integration system, method, equipment and storage medium | |
| CN115629909A (en) | Service data processing method and device, electronic equipment and storage medium | |
| CN114817342A (en) | Data synchronization method, device, equipment and medium | |
| JP5469166B2 (en) | Adapter for synchronizing data on different networks | |
| CN115189931A (en) | Distributed key management method, device, equipment and storage medium | |
| US20240015135A1 (en) | Domain management and synchronization system | |
| CN113301088B (en) | Message processing method, device and system, electronic equipment and readable storage medium | |
| CN115022392B (en) | IOT-oriented distributed publishing and subscribing service method and system | |
| CN117041284A (en) | External interface management method, system, equipment and medium based on interface cloud | |
| CN107306290B (en) | A session session sharing method and application server | |
| CN115883583A (en) | Data synchronization method and device and multi-stage platform data synchronization system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address | Address after:Building 9, No.1, guanpu Road, Guoxiang street, Wuzhong Economic Development Zone, Wuzhong District, Suzhou City, Jiangsu Province Patentee after:Suzhou Yuannao Intelligent Technology Co.,Ltd. Country or region after:China Address before:Building 9, No.1, guanpu Road, Guoxiang street, Wuzhong Economic Development Zone, Wuzhong District, Suzhou City, Jiangsu Province Patentee before:SUZHOU LANGCHAO INTELLIGENT TECHNOLOGY Co.,Ltd. Country or region before:China |