技术领域Technical field
本发明涉及计算机技术领域，特别涉及一种缓存数据同步方法、装置、设备及介质。The present invention relates to the field of computer technology, and in particular to a cache data synchronization method, device, equipment and medium.
背景技术Background technique
为提高应用系统中系统的访问速度，往往在应用层面加入缓存机制，也就是将查询的数据放在内存中，Redis(Remote Dictionary Server，远程字典服务)是对缓存数据管理的重要内存数据库。在多服务集群模式下的数据缓存的管理既要保证数据的一致性，又要保证数据的实时性，及时可靠是对缓存同步的一个基本要求。现有的远程字典服务中缓存数据的同步方式可以分为以下几种：In order to improve the access speed of the system in the application system, a caching mechanism is often added at the application level, that is, the queried data is placed in the memory. Redis (Remote Dictionary Server, remote dictionary service) is an important in-memory database for cached data management. The management of data cache in multi-service cluster mode must not only ensure data consistency, but also ensure the real-time nature of data. Timeliness and reliability are a basic requirement for cache synchronization. The existing synchronization methods of cached data in remote dictionary services can be divided into the following types:
(1)如图1所示，应用服务器连接多个Redis服务器，多个Redis服务器分别对应多个客户端，实现缓存数据的同步，这种方式的缺点是：应用服务器需要同步连接多个Redis服务，也即应用服务器的压力增加。(1) As shown in Figure 1, the application server connects to multiple Redis servers, and the multiple Redis servers correspond to multiple clients to achieve synchronization of cached data. The disadvantage of this method is that the application server needs to connect to multiple Redis services synchronously. , that is, the pressure on the application server increases.
(2)如图2所示，采用Redis备份机制，实现一对多数据同步，针对一个主Redis服务器，其他从Redis服务器通过同步主服务器缓存数据，实现缓存数据的同步，这种方式的缺点是：主服务器在更新缓存的时候，还需要处理从Redis服务器的数据同步的请求，也即主Redis服务器的压力增大。(2) As shown in Figure 2, the Redis backup mechanism is used to achieve one-to-many data synchronization. For one master Redis server, other slave Redis servers synchronize the cache data of the master server to achieve synchronization of cached data. The disadvantages of this method are : When the main server updates the cache, it also needs to process data synchronization requests from the Redis server, which means the pressure on the main Redis server increases.
(3)如图3所示，加入多个主Redis服务器，此时同步到从Redis服务器的压力减小，但是不能保证各主Redis服务器缓存数据的一致性。(3) As shown in Figure 3, when multiple master Redis servers are added, the pressure to synchronize to the slave Redis servers is reduced, but the consistency of the cached data of each master Redis server cannot be guaranteed.
因此，在进行缓存数据同步时，减轻应用服务器和主服务器的压力，并实现缓存数据一致性是本领域亟待解决的问题Therefore, when synchronizing cache data, reducing the pressure on the application server and the main server and achieving cache data consistency are issues that need to be solved urgently in this field.
发明内容Contents of the invention
有鉴于此，本发明的目的在于提供一种缓存数据同步方法、装置、设备及介质，能够解决一个主服务器连接多个从服务器时，主服务器压力大的问题，并且保证缓存数据的一致性，其具体方案如下：In view of this, the purpose of the present invention is to provide a cache data synchronization method, device, equipment and medium that can solve the problem of high pressure on the master server when a master server connects to multiple slave servers, and ensure the consistency of the cache data. The specific plan is as follows:
第一方面，本申请公开了一种缓存数据同步方法，应用于分布式消息中间件系统，包括：In the first aspect, this application discloses a cache data synchronization method, which is applied to a distributed message middleware system, including:
获取远程字典服务集群的主服务器中的目标缓存数据；所述目标缓存数据为应用服务器在业务数据发生变更后将相应的变更后业务数据保存至所述主服务器后得到的缓存数据；Obtain the target cache data in the main server of the remote dictionary service cluster; the target cache data is the cache data obtained after the application server saves the corresponding changed business data to the main server after the business data changes;
通过所述分布式消息中间件系统的服务端将所述目标缓存数据广播至所述分布式消息中间件系统的各客户端；不同的所述客户端分别对应于所述远程字典服务集群中不同的从服务器；The target cache data is broadcast to each client of the distributed message middleware system through the server of the distributed message middleware system; different clients respectively correspond to different clients in the remote dictionary service cluster. the slave server;
控制所述分布式消息中间件系统的每个所述客户端将各自获取到的所述目标缓存数据分别传输至相应的所述从服务器，以便每台所述从服务器将各自获取到的所述目标缓存数据保存至各自的本地缓存空间。Each client that controls the distributed message middleware system transmits the target cache data obtained by itself to the corresponding slave server, so that each slave server transmits the obtained target cache data by each server. The target cache data is saved to the respective local cache space.
可选的，所述获取远程字典服务集群的主服务器中的目标缓存数据，包括：Optionally, obtaining the target cache data in the main server of the remote dictionary service cluster includes:
读取远程字典服务集群的主服务器中的缓存数据文件，并通过数据文件转换器对读取到的所述缓存数据文件进行文件转换处理，以得到所述目标缓存数据。Read the cached data file in the main server of the remote dictionary service cluster, and perform file conversion processing on the read cached data file through a data file converter to obtain the target cached data.
可选的，所述读取远程字典服务集群的主服务器中的缓存数据文件，包括：Optionally, reading the cached data file in the main server of the remote dictionary service cluster includes:
读取远程字典服务集群的主服务器中的RDB文件，并在读取到所述RDB文件后读取所述主服务器中的AOF文件。Read the RDB file in the main server of the remote dictionary service cluster, and read the AOF file in the main server after reading the RDB file.
可选的，所述读取远程字典服务集群的主服务器中的RDB文件，并在读取到所述RDB文件后读取所述主服务器中的AOF文件，包括：Optionally, reading the RDB file in the main server of the remote dictionary service cluster, and reading the AOF file in the main server after reading the RDB file, includes:
基于预设时间周期，定期读取远程字典服务集群的主服务器中的RDB文件，并在读取到所述RDB文件后读取所述主服务器中的AOF文件。Based on a preset time period, the RDB file in the main server of the remote dictionary service cluster is regularly read, and after the RDB file is read, the AOF file in the main server is read.
可选的，所述通过数据文件转换器对读取到的所述缓存数据文件进行文件转换处理，以得到所述目标缓存数据，包括：Optionally, the data file converter performs file conversion processing on the read cache data file to obtain the target cache data, including:
通过所述数据文件转换器，对读取到的所述RDB文件和所述AOF文件分别进行解析得到相应的第一解析后数据和第二解析后数据，并以键值对作为数据记录方式对所述第一解析后数据和所述第二解析后数据进行重新封装，以得到所述目标缓存数据。Through the data file converter, the read RDB file and the AOF file are parsed respectively to obtain the corresponding first parsed data and second parsed data, and key-value pairs are used as data recording methods. The first parsed data and the second parsed data are re-encapsulated to obtain the target cache data.
可选的，所述缓存数据同步方法，还包括：Optionally, the cache data synchronization method also includes:
在读取所述主服务器中的AOF文件之后，记录相应的AOF文件的读取位置。After reading the AOF file in the main server, the reading position of the corresponding AOF file is recorded.
可选的，所述通过所述分布式消息中间件系统的服务端将所述目标缓存数据广播至所述分布式消息中间件系统的各客户端之前，还包括：Optionally, before broadcasting the target cache data to each client of the distributed message middleware system through the server of the distributed message middleware system, the method further includes:
通过所述分布式消息中间件系统的服务端为所述目标缓存数据设置一个消息主题，并为所述消息主题配置一个消息队列，然后将所述目标缓存数据以消息的形式保存至所述消息队列；Set a message topic for the target cache data through the server of the distributed message middleware system, configure a message queue for the message topic, and then save the target cache data to the message in the form of a message. queue;
相应的，所述通过所述分布式消息中间件系统的服务端将所述目标缓存数据广播至所述分布式消息中间件系统的各客户端，包括：Correspondingly, broadcasting the target cache data to each client of the distributed message middleware system through the server of the distributed message middleware system includes:
通过所述分布式消息中间件系统的服务端，获取每个客户端针对所述消息主题的订阅请求，然后将所述消息队列中保存的所述目标缓存数据广播至所述分布式消息中间件系统的各客户端。Through the server of the distributed message middleware system, each client's subscription request for the message topic is obtained, and then the target cache data saved in the message queue is broadcast to the distributed message middleware Each client of the system.
第二方面，本申请公开了一种缓存数据同步装置，应用于分布式消息中间件系统，包括：In the second aspect, this application discloses a cache data synchronization device applied to a distributed message middleware system, including:
数据获取模块，用于获取远程字典服务集群的主服务器中的目标缓存数据；所述目标缓存数据为应用服务器在业务数据发生变更后将相应的变更后业务数据保存至所述主服务器后得到的缓存数据；The data acquisition module is used to obtain the target cache data in the main server of the remote dictionary service cluster; the target cache data is obtained after the application server saves the corresponding changed business data to the main server after the business data changes. cache data;
数据广播模块，用于通过所述分布式消息中间件系统的服务端将所述目标缓存数据广播至所述分布式消息中间件系统的各客户端；不同的所述客户端分别对应于所述远程字典服务集群中不同的从服务器；A data broadcast module, configured to broadcast the target cache data to each client of the distributed message middleware system through the server of the distributed message middleware system; different clients respectively correspond to the Different slave servers in the remote dictionary service cluster;
数据发送模块，用于控制所述分布式消息中间件系统的每个所述客户端将各自获取到的所述目标缓存数据分别传输至相应的所述从服务器，以便每台所述从服务器将各自获取到的所述目标缓存数据保存至各自的本地缓存空间。A data sending module, configured to control each client of the distributed message middleware system to respectively transmit the obtained target cache data to the corresponding slave server, so that each slave server will The target cache data obtained respectively is saved in respective local cache spaces.
第三方面，本申请公开了一种电子设备，包括：In a third aspect, this application discloses an electronic device, including:
存储器，用于保存计算机程序；Memory, used to hold computer programs;
处理器，用于执行所述计算机程序，以实现前述公开的缓存数据同步方法。A processor, configured to execute the computer program to implement the previously disclosed cache data synchronization method.
第四方面，本申请公开了一种计算机可读存储介质，用于保存计算机程序；其中，所述计算机程序被处理器执行时实现前述公开的缓存数据同步方法。In a fourth aspect, the present application discloses a computer-readable storage medium for storing a computer program; wherein when the computer program is executed by a processor, the previously disclosed cache data synchronization method is implemented.
可见，本申请提出一种缓存数据同步方法，包括：获取远程字典服务集群的主服务器中的目标缓存数据；所述目标缓存数据为应用服务器在业务数据发生变更后将相应的变更后业务数据保存至所述主服务器后得到的缓存数据；通过所述分布式消息中间件系统的服务端将所述目标缓存数据广播至所述分布式消息中间件系统的各客户端；不同的所述客户端分别对应于所述远程字典服务集群中不同的从服务器；控制所述分布式消息中间件系统的每个所述客户端将各自获取到的所述目标缓存数据分别传输至相应的所述从服务器，以便每台所述从服务器将各自获取到的所述目标缓存数据保存至各自的本地缓存空间，如此一来，本申请中的应用服务器只连接一个主服务器，因此减轻了应用服务器的压力。此外，本申请在主从服务器之间加入了分布式消息中间件系统，并利用分布式消息中间件系统来处理从服务器的数据同步请求，从而减轻了主服务器的压力。最后，具有广播发送的机制并且只有一个主服务器实现了缓存数据的实时同步，保证了从服务器上的数据的一致性。It can be seen that this application proposes a cache data synchronization method, which includes: obtaining the target cache data in the main server of the remote dictionary service cluster; the target cache data is that the application server saves the corresponding changed business data after the business data changes. The cached data obtained after reaching the main server; broadcasting the target cached data to each client of the distributed message middleware system through the server of the distributed message middleware system; different clients Corresponding to different slave servers in the remote dictionary service cluster respectively; each client that controls the distributed message middleware system transmits the target cache data obtained to the corresponding slave server respectively. , so that each slave server saves the obtained target cache data to its own local cache space. In this way, the application server in this application only connects to one master server, thus reducing the pressure on the application server. In addition, this application adds a distributed message middleware system between the master and slave servers, and uses the distributed message middleware system to process data synchronization requests from the slave servers, thus reducing the pressure on the master server. Finally, it has a broadcast sending mechanism and only one master server to achieve real-time synchronization of cached data, ensuring the consistency of data on the slave server.
附图说明Description of drawings
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据提供的附图获得其他的附图。In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings in the following description are only These are embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on the provided drawings without exerting creative efforts.
图1为第一种现有的缓存数据同步方法示意图；Figure 1 is a schematic diagram of the first existing cache data synchronization method;
图2为第二种现有的缓存数据同步方法示意图；Figure 2 is a schematic diagram of the second existing cache data synchronization method;
图3为第三种现有的缓存数据同步方法示意图；Figure 3 is a schematic diagram of the third existing cache data synchronization method;
图4为本申请公开的一种缓存数据同步方法流程图；Figure 4 is a flow chart of a cache data synchronization method disclosed in this application;
图5为本申请公开的一种具体的缓存数据同步方法流程图；Figure 5 is a flow chart of a specific cache data synchronization method disclosed in this application;
图6为本申请公开的一种具体的缓存数据同步方法结构示意图；Figure 6 is a schematic structural diagram of a specific cache data synchronization method disclosed in this application;
图7为本申请公开的一种缓存数据同步装置结构示意图；Figure 7 is a schematic structural diagram of a cache data synchronization device disclosed in this application;
图8为本申请公开的一种电子设备结构图。Figure 8 is a structural diagram of an electronic device disclosed in this application.
具体实施方式Detailed ways
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of protection of the present invention.
在进行缓存数据同步时，现有技术面临应用服务器和主服务器的压力大，并且不能保证缓存数据一致性的问题。为此，本申请实施例提出一种缓存数据同步方案，能够减轻应用服务器和主服务器的压力，并实现缓存数据一致性。When synchronizing cache data, the existing technology faces the problem of high pressure on the application server and the main server, and cannot guarantee the consistency of the cache data. To this end, embodiments of this application propose a cache data synchronization solution, which can reduce the pressure on the application server and the main server and achieve cache data consistency.
本申请实施例公开了一种缓存数据同步方法，参见图4所示，该方法包括：The embodiment of the present application discloses a cache data synchronization method, as shown in Figure 4. The method includes:
步骤S11：获取远程字典服务集群的主服务器中的目标缓存数据；所述目标缓存数据为应用服务器在业务数据发生变更后将相应的变更后业务数据保存至所述主服务器后得到的缓存数据。Step S11: Obtain the target cache data in the main server of the remote dictionary service cluster; the target cache data is the cache data obtained after the application server saves the corresponding changed business data to the main server after the business data changes.
本实施中的远程字典服务(Redis)，是一个完全开源的、遵守BSD(BerkeleySoftware Distribution，伯克利软件发行版)协议并且高性能的键值对(Key-Value)数据库，用来存储缓存数据。需要指出的是，应用层面会进行数据的更新，得到缓存数据，将缓存数据传输至远程字典服务集群的主服务器中，远程字典服务器能够将内存中的缓存持久化到磁盘上，进行持久化保存。所以分布式消息中间件系统在进行缓存数据同步时，首先需要获取远程字典服务集群的主服务器中的目标缓存数据，可以理解的是，获取到的目标缓存数据是会根据实际场景而产生变更的，所以，所述目标缓存数据为应用服务器在业务数据发生变更后将相应的变更后业务数据保存至所述主服务器后得到的缓存数据。The remote dictionary service (Redis) in this implementation is a completely open source, compliant with BSD (Berkeley Software Distribution, Berkeley Software Distribution) protocol and high-performance key-value database, used to store cached data. It should be pointed out that the application layer will update the data, obtain the cached data, and transfer the cached data to the main server of the remote dictionary service cluster. The remote dictionary server can persist the cache in the memory to the disk for persistent storage. . Therefore, when the distributed message middleware system synchronizes cache data, it first needs to obtain the target cache data in the main server of the remote dictionary service cluster. It is understandable that the obtained target cache data will change according to the actual scenario. , therefore, the target cache data is the cache data obtained after the application server saves the corresponding changed business data to the main server after the business data is changed.
具体的，在远程字典服务器进行持久化保存的过程中，首先需要在远程字典服务集群的主服务器中配置文件，利用redis.conf进行配置，开启远程字典服务的持久化功能，其格式如下：Specifically, in the process of persisting the remote dictionary server, you first need to configure the file in the main server of the remote dictionary service cluster, use redis.conf for configuration, and enable the persistence function of the remote dictionary service. The format is as follows:
RDB持久化配置：RDB persistence configuration:
save 900 1save 900 1
save 300 10save 300 10
save 60 10000；save 60 10000;
AOF持久化配置：AOF persistence configuration:
appendfsync always#每次有数据修改发生时都会写入AOF文件。appendfsync always#The AOF file will be written every time a data modification occurs.
需要指出的是，在分布式消息中间件系统中加入了远程字典服务数据转换器，因为远程字典服务器保存的数据文件有两种方式：一种是RDB(Redis Database)文件，定时将缓存数据导出到RDB文件中；另一种是AOF(Append Only File)文件，将远程字典服务的操作日志以追加的方式写入文件；所以在获取远程字典服务集群的主服务器中的目标缓存数据的过程中，首先要利用分布式消息中间件系统中的远程字典服务数据转换器对读取到的远程字典服务集群的主服务器中的缓存数据文件进行文件转换处理，数据转换器将RDB文件或者AOF文件进行数据解析，得到相应的第一解析后数据和第二解析后数据，然后以键值对(key-value)作为数据记录方式对第一解析后数据和第二解析后数据进行重新封装，以得到目标缓存数据。It should be pointed out that a remote dictionary service data converter has been added to the distributed message middleware system, because there are two ways to save data files on the remote dictionary server: one is an RDB (Redis Database) file, which regularly exports cached data. to the RDB file; the other is the AOF (Append Only File) file, which writes the operation log of the remote dictionary service to the file in an appended manner; so in the process of obtaining the target cache data in the main server of the remote dictionary service cluster , first of all, the remote dictionary service data converter in the distributed message middleware system must be used to perform file conversion processing on the read cached data files in the main server of the remote dictionary service cluster. The data converter converts the RDB file or AOF file. Data parsing, obtain the corresponding first parsed data and second parsed data, and then re-encapsulate the first parsed data and second parsed data using key-value pairs as data recording methods to obtain Target cache data.
本申请实施例中，对于分布式消息中间件系统中的远程字典服务数据转换器会进行定时配置，这样数据转换器则会基于预设时间周期，定期读取远程字典服务集群的主服务器中最新的RDB文件，并在读取到RDB文件后读取主服务器中的AOF文件。可以理解的是，在进行AOF文件持久化配置的时候，一旦缓存区的内容发生了变化，就将其写入到AOF文件中，当读取到RDB文件后实现了远程字典服务的全量同步，在应用层面缓存有更新的时候，再读取主服务器中的AOF文件，实现了远程字典服务的增量同步，可以进一步提高传输数据的速度和数据同步的效率。需要指出的是，在读取所述主服务器中的AOF文件之后，要随时记录相应的AOF文件的读取位置。In the embodiment of this application, the remote dictionary service data converter in the distributed message middleware system will be configured regularly, so that the data converter will regularly read the latest information from the main server of the remote dictionary service cluster based on a preset time period. RDB file, and after reading the RDB file, read the AOF file in the main server. It is understandable that when configuring AOF file persistence, once the content of the cache area changes, it is written to the AOF file. When the RDB file is read, full synchronization of the remote dictionary service is achieved. When the application-level cache is updated, the AOF file in the main server is read again to achieve incremental synchronization of the remote dictionary service, which can further improve the speed of data transmission and the efficiency of data synchronization. It should be pointed out that after reading the AOF file in the main server, the reading position of the corresponding AOF file should be recorded at any time.
步骤S12：通过所述分布式消息中间件系统的服务端将所述目标缓存数据广播至所述分布式消息中间件系统的各客户端；不同的所述客户端分别对应于所述远程字典服务集群中不同的从服务器。Step S12: Broadcast the target cache data to each client of the distributed message middleware system through the server of the distributed message middleware system; different clients respectively correspond to the remote dictionary service Different slave servers in the cluster.
本实施例中，在Redis主服务器以及从服务器之间加入了分布式消息中间件以进行数据广播。具体的，在获取到所述目标缓存数据后，将所述目标缓存数据发送至分布式消息中间件系统的服务端，然后由所述分布式消息中间件系统的服务端将所述目标缓存数据广播至所述分布式消息中间件系统的各客户端，并且只有注册在所述分布式消息中间件服务端的所述分布式消息中间件系统的各客户端才能够接收到所述目标缓存数据。本申请中，通过广播发送的方式实现了从服务器接收数据的一致性。需要注意的是，为了将所述目标缓存数据发送至分布式消息中间件系统的服务端，在数据转换器中部署了一个客户端。In this embodiment, distributed message middleware is added between the Redis master server and the slave server for data broadcast. Specifically, after obtaining the target cache data, the target cache data is sent to the server of the distributed message middleware system, and then the server of the distributed message middleware system sends the target cache data to Broadcast to each client of the distributed message middleware system, and only each client of the distributed message middleware system registered on the distributed message middleware server can receive the target cache data. In this application, the consistency of data received from the server is achieved through broadcast transmission. It should be noted that in order to send the target cache data to the server of the distributed message middleware system, a client is deployed in the data converter.
本实施例中，为所述主服务器建立了多个从服务器节点，并且设定好不同的所述客户端分别对应于所述远程字典服务集群中不同的从服务器，也即，每个所述从服务器节点对应一个所述分布式消息中间件系统的客户端。In this embodiment, multiple slave server nodes are established for the main server, and different clients are set to correspond to different slave servers in the remote dictionary service cluster, that is, each of the The slave server node corresponds to a client of the distributed message middleware system.
步骤S13：控制所述分布式消息中间件系统的每个所述客户端将各自获取到的所述目标缓存数据分别传输至相应的所述从服务器，以便每台所述从服务器将各自获取到的所述目标缓存数据保存至各自的本地缓存空间。Step S13: Control each client of the distributed message middleware system to respectively transmit the target cache data obtained to the corresponding slave server, so that each slave server will obtain the target cache data respectively. The target cache data is saved to respective local cache spaces.
本实施例中，由于不同的所述客户端分别对应于所述远程字典服务集群中不同的从服务器，因此所述分布式消息中间件系统控制所述分布式消息中间件系统的每个所述客户端将各自获取到的所述目标缓存数据分别传输至相应的所述从服务器，以便每台所述从服务器将各自获取到的所述目标缓存数据保存至各自的本地缓存空间。In this embodiment, since different clients correspond to different slave servers in the remote dictionary service cluster, the distributed message middleware system controls each of the distributed message middleware systems. The client transmits the target cache data obtained respectively to the corresponding slave server, so that each slave server saves the target cache data obtained respectively in its own local cache space.
可见，本申请提出一种缓存数据同步方法，包括：获取远程字典服务集群的主服务器中的目标缓存数据；所述目标缓存数据为应用服务器在业务数据发生变更后将相应的变更后业务数据保存至所述主服务器后得到的缓存数据；通过所述分布式消息中间件系统的服务端将所述目标缓存数据广播至所述分布式消息中间件系统的各客户端；不同的所述客户端分别对应于所述远程字典服务集群中不同的从服务器；控制所述分布式消息中间件系统的每个所述客户端将各自获取到的所述目标缓存数据分别传输至相应的所述从服务器，以便每台所述从服务器将各自获取到的所述目标缓存数据保存至各自的本地缓存空间，如此一来，本申请中的应用服务器只连接一个主服务器，因此减轻了应用服务器的压力。此外，本申请在主从服务器之间加入了分布式消息中间件系统，并利用分布式消息中间件系统来处理从服务器的数据同步请求，从而减轻了主服务器的压力。最后，具有广播发送的机制并且只有一个主服务器实现了缓存数据的实时同步，保证了从服务器上的数据的一致性。It can be seen that this application proposes a cache data synchronization method, which includes: obtaining the target cache data in the main server of the remote dictionary service cluster; the target cache data is that the application server saves the corresponding changed business data after the business data changes. The cached data obtained after reaching the main server; broadcasting the target cached data to each client of the distributed message middleware system through the server of the distributed message middleware system; different clients Corresponding to different slave servers in the remote dictionary service cluster respectively; each client that controls the distributed message middleware system transmits the target cache data obtained to the corresponding slave server respectively. , so that each slave server saves the obtained target cache data to its own local cache space. In this way, the application server in this application only connects to one master server, thus reducing the pressure on the application server. In addition, this application adds a distributed message middleware system between the master and slave servers, and uses the distributed message middleware system to process data synchronization requests from the slave servers, thus reducing the pressure on the master server. Finally, it has a broadcast sending mechanism and only one master server to achieve real-time synchronization of cached data, ensuring the consistency of data on the slave server.
本申请实施例公开了一种具体的缓存数据同步方法，参见图5所示，该方法包括：The embodiment of this application discloses a specific cache data synchronization method, as shown in Figure 5. The method includes:
步骤S21：获取远程字典服务集群的主服务器中的目标缓存数据；所述目标缓存数据为应用服务器在业务数据发生变更后将相应的变更后业务数据保存至所述主服务器后得到的缓存数据。Step S21: Obtain the target cache data in the main server of the remote dictionary service cluster; the target cache data is the cache data obtained after the application server saves the corresponding changed business data to the main server after the business data changes.
其中，关于上述步骤S21更加具体的处理过程可以参考前述实施例中公开的相应内容，在此不再进行赘述。For more specific processing of the above step S21, reference may be made to the corresponding content disclosed in the foregoing embodiments, which will not be described again here.
步骤S22：通过所述分布式消息中间件系统的服务端为所述目标缓存数据设置一个消息主题，并为所述消息主题配置一个消息队列，然后将所述目标缓存数据以消息的形式保存至所述消息队列。Step S22: Set a message topic for the target cache data through the server of the distributed message middleware system, configure a message queue for the message topic, and then save the target cache data in the form of a message to The message queue.
本申请实施例中，在获取到远程字典服务集群的主服务器中的目标缓存数据后，需要对分布式消息中间件系统的服务端进行集群部署，然后广播数据。具体的，在分布式消息中间件系统的服务端为目标缓存数据设置一个消息主题，并为所述消息主题配置一个消息队列，然后将所述目标缓存数据以消息的形式保存至所述消息队列，以供分布式消息中间件集群中对应的每个客户端获取目标缓存数据，并将所述目标缓存数据广播到注册在其相应的分布式消息中间件客户端的远程字典服务集群的从服务器上。In the embodiment of this application, after obtaining the target cache data in the main server of the remote dictionary service cluster, it is necessary to cluster-deploy the server of the distributed message middleware system and then broadcast the data. Specifically, a message topic is set for the target cache data on the server side of the distributed message middleware system, and a message queue is configured for the message topic, and then the target cache data is saved to the message queue in the form of a message. , for each corresponding client in the distributed message middleware cluster to obtain the target cache data, and broadcast the target cache data to the slave server of the remote dictionary service cluster registered in its corresponding distributed message middleware client .
可以理解的是，因为每个队列中消息顺序一定，发送数据的时候有先后顺序，设置为一个消息主题，并将该主题设置成只有一个队列，这样还原的时候也会基于发送数据时的顺序，可以保证备份数据的顺序一致性。It is understandable that because the order of messages in each queue is certain, there is a sequence when sending data. Set it as a message topic, and set the topic to have only one queue. In this way, the restoration will also be based on the order in which data is sent. , which can ensure the sequential consistency of backup data.
步骤S23：通过所述分布式消息中间件系统的服务端，获取每个客户端针对所述消息主题的订阅请求，然后将所述消息队列中保存的所述目标缓存数据广播至所述分布式消息中间件系统的各客户端。Step S23: Obtain each client's subscription request for the message topic through the server of the distributed message middleware system, and then broadcast the target cache data saved in the message queue to the distributed message queue. Each client of the message middleware system.
本实施例中，当所述分布式消息中间件的各客户端需要所述目标缓存数据时，所述分布式消息中间件的各客户端向所述分布式消息中间件系统的服务端发送所述目标缓存数据对应的所述消息主题的订阅请求，所述分布式消息中间件系统的服务端获取到每个客户端针对所述消息主题的订阅请求后，将所述消息队列中保存的所述目标缓存数据广播至所述分布式消息中间件系统的各客户端。In this embodiment, when each client of the distributed message middleware needs the target cache data, each client of the distributed message middleware sends the requested data to the server of the distributed message middleware system. The subscription request of the message topic corresponding to the target cache data is obtained. After the server of the distributed message middleware system obtains the subscription request of each client for the message topic, it stores all the messages saved in the message queue. The target cache data is broadcast to each client of the distributed message middleware system.
步骤S24：控制所述分布式消息中间件系统的每个所述客户端将各自获取到的所述目标缓存数据分别传输至相应的所述从服务器，以便每台所述从服务器将各自获取到的所述目标缓存数据保存至各自的本地缓存空间。Step S24: Control each client of the distributed message middleware system to respectively transmit the target cache data obtained to the corresponding slave server, so that each slave server will obtain the target cache data respectively. The target cache data is saved to respective local cache spaces.
本实施例中，所述分布式消息中间件系统的每个所述客户端将各自获取到的所述目标缓存数据分别传输至相应的所述从服务器中，需要注意的是，所述目标缓存数据在所述消息队列中以消息形式进行存储，因此所述从服务器获取到的所述目标缓存数据仍然是消息形式，进一步的需要将消息形式的所述目标缓存数据进行解析，以便每台所述从服务器将各自获取到的所述目标缓存数据保存至各自的本地缓存空间，从而实现缓存数据的同步。In this embodiment, each client of the distributed message middleware system transmits the target cache data obtained respectively to the corresponding slave server. It should be noted that the target cache data The data is stored in the message form in the message queue, so the target cache data obtained from the server is still in the message form. It is further necessary to parse the target cache data in the message form so that each The slave servers save the obtained target cache data to their respective local cache spaces, thereby realizing synchronization of the cache data.
可见，本申请实施例提供了一种缓存数据同步的方法，首先通过获取远程字典服务集群的主服务器中的目标缓存数据；所述目标缓存数据为应用服务器在业务数据发生变更后将相应的变更后业务数据保存至所述主服务器后得到的缓存数据；再通过所述分布式消息中间件系统的服务端为所述目标缓存数据设置一个消息主题，并为所述消息主题配置一个消息队列，然后将所述目标缓存数据以消息的形式保存至所述消息队列；通过所述分布式消息中间件系统的服务端，获取每个客户端针对所述消息主题的订阅请求，然后将所述消息队列中保存的所述目标缓存数据广播至所述分布式消息中间件系统的各客户端；最后控制所述分布式消息中间件系统的每个所述客户端将各自获取到的所述目标缓存数据分别传输至相应的所述从服务器，以便每台所述从服务器将各自获取到的所述目标缓存数据保存至各自的本地缓存空间。可见，通过分布式消息中间件系统的服务端的广播通知机制将目标缓存数据广播至分布式消息中间件系统的各客户端，并为服务端设置一个消息的主题，将该主题设置成只有一个队列，保证了备份数据的顺序一致性。并且，由于本申请中的应用服务器只连接一个主服务器，因此减轻了应用服务器的压力。此外，本申请在主从服务器之间加入了分布式消息中间件系统，并利用分布式消息中间件系统来处理从服务器的数据同步请求，从而减轻了主服务器的压力。最后，具有广播发送的机制并且只有一个主服务器实现了缓存数据的实时同步，保证了从服务器上的数据的一致性。It can be seen that the embodiment of the present application provides a cache data synchronization method. First, the target cache data in the main server of the remote dictionary service cluster is obtained; the target cache data is the application server that changes the corresponding changes after the business data changes. The business data is saved to the cache data obtained after the main server; then a message topic is set for the target cache data through the server of the distributed message middleware system, and a message queue is configured for the message topic, Then the target cache data is saved to the message queue in the form of a message; through the server of the distributed message middleware system, each client's subscription request for the message topic is obtained, and then the message is The target cache data saved in the queue is broadcast to each client of the distributed message middleware system; finally, each client of the distributed message middleware system is controlled to obtain the target cache data respectively. The data is respectively transmitted to the corresponding slave servers, so that each of the slave servers saves the obtained target cache data to its own local cache space. It can be seen that through the broadcast notification mechanism of the server of the distributed message middleware system, the target cache data is broadcast to each client of the distributed message middleware system, and a message topic is set for the server, and the topic is set to have only one queue. , ensuring the sequential consistency of backup data. Moreover, since the application server in this application only connects to one main server, the pressure on the application server is reduced. In addition, this application adds a distributed message middleware system between the master and slave servers, and uses the distributed message middleware system to process data synchronization requests from the slave servers, thus reducing the pressure on the master server. Finally, it has a broadcast sending mechanism and only one master server to achieve real-time synchronization of cached data, ensuring the consistency of data on the slave server.
图6给出了关于缓存数据同步方法的具体过程的结构示意图。Figure 6 shows a schematic structural diagram of the specific process of the cache data synchronization method.
需要指出的是，本实施例在数据文件转换器中部署了RocketMQ客户端，用来将经过数据文件转换器转换后得到的所述目标缓存数据发送给所述分布式消息中间件系统的RocketMQ服务端。参见图6所示，本实施例中的应用服务器在业务数据发生变更后将相应的变更后业务数据保存至所述主Redis服务器，在主Redis服务器中，缓存数据经过配置后得到RDB文件和AOF文件，然后经数据文件转换器对读取到的RDB文件和AOF文件进行文件转换处理，得到目标缓存数据，并由数据文件转换器中预先部署的RocketMQ客户端将所述目标缓存数据发送给所述分布式消息中间件系统的RocketMQ服务端。需要指出的是，所述目标缓存数据是以消息的形式保存在所述分布式消息中间件系统的RocketMQ服务端中的消息队列中的，并且所述目标缓存数据对应一个消息主题，因此基于每个RocketMQ客户端订阅的所述消息主题，所述分布式消息中间件系统的RocketMQ服务端会将所述消息队列中保存的所述目标缓存数据广播至所述分布式消息中间件系统的各RocketMQ客户端，最后所述分布式消息中间件系统控制所述分布式消息中间件系统的每个所述RocketMQ客户端将各自获取到的所述目标缓存数据分别传输至相应的所述从Redis服务器，以便每台所述从Redis服务器将各自获取到的所述目标缓存数据保存至各自的本地缓存空间。It should be pointed out that in this embodiment, a RocketMQ client is deployed in the data file converter to send the target cache data converted by the data file converter to the RocketMQ service of the distributed message middleware system. end. As shown in Figure 6, after the business data is changed, the application server in this embodiment saves the corresponding changed business data to the main Redis server. In the main Redis server, the cached data is configured to obtain the RDB file and AOF. file, and then perform file conversion processing on the read RDB file and AOF file through the data file converter to obtain the target cache data, and the RocketMQ client pre-deployed in the data file converter will send the target cache data to all Describes the RocketMQ server of the distributed message middleware system. It should be pointed out that the target cache data is stored in the message queue in the RocketMQ server of the distributed message middleware system in the form of messages, and the target cache data corresponds to a message topic, so it is based on each If a RocketMQ client subscribes to the message topic, the RocketMQ server of the distributed message middleware system will broadcast the target cache data saved in the message queue to each RocketMQ of the distributed message middleware system. Client, finally, the distributed message middleware system controls each RocketMQ client of the distributed message middleware system to respectively transmit the target cache data obtained to the corresponding slave Redis server, So that each slave Redis server saves the target cache data obtained by itself to its own local cache space.
相应的，本申请实施例还公开了一种缓存数据同步装置，参见图7所示，该装置包括：Correspondingly, the embodiment of the present application also discloses a cache data synchronization device, as shown in Figure 7. The device includes:
数据获取模块11：获取远程字典服务集群的主服务器中的目标缓存数据；所述目标缓存数据为应用服务器在业务数据发生变更后将相应的变更后业务数据保存至所述主服务器后得到的缓存数据；Data acquisition module 11: Obtain the target cache data in the main server of the remote dictionary service cluster; the target cache data is the cache obtained after the application server saves the corresponding changed business data to the main server after the business data changes. data;
数据广播模块12：通过所述分布式消息中间件系统的服务端将所述目标缓存数据广播至所述分布式消息中间件系统的各客户端；不同的所述客户端分别对应于所述远程字典服务集群中不同的从服务器；Data broadcast module 12: broadcasts the target cache data to each client of the distributed message middleware system through the server of the distributed message middleware system; different clients respectively correspond to the remote Different slave servers in the dictionary service cluster;
数据发送模块13：控制所述分布式消息中间件系统的每个所述客户端将各自获取到的所述目标缓存数据分别传输至相应的所述从服务器，以便每台所述从服务器将各自获取到的所述目标缓存数据保存至各自的本地缓存空间。Data sending module 13: Control each client of the distributed message middleware system to respectively transmit the target cache data obtained to the corresponding slave server, so that each slave server sends its respective The obtained target cache data is saved to respective local cache spaces.
其中，关于上述各个模块更加具体的工作过程可以参考前述实施例中公开的相应内容，在此不再进行赘述。For more specific working processes of each of the above modules, reference can be made to the corresponding content disclosed in the foregoing embodiments, and will not be described again here.
可见，本申请提出一种缓存数据同步方法，包括：获取远程字典服务集群的主服务器中的目标缓存数据；所述目标缓存数据为应用服务器在业务数据发生变更后将相应的变更后业务数据保存至所述主服务器后得到的缓存数据；通过所述分布式消息中间件系统的服务端将所述目标缓存数据广播至所述分布式消息中间件系统的各客户端；不同的所述客户端分别对应于所述远程字典服务集群中不同的从服务器；控制所述分布式消息中间件系统的每个所述客户端将各自获取到的所述目标缓存数据分别传输至相应的所述从服务器，以便每台所述从服务器将各自获取到的所述目标缓存数据保存至各自的本地缓存空间，如此一来，本申请中的应用服务器只连接一个主服务器，因此减轻了应用服务器的压力。此外，本申请在主从服务器之间加入了分布式消息中间件系统，并利用分布式消息中间件系统来处理从服务器的数据同步请求，从而减轻了主服务器的压力。最后，具有广播发送的机制并且只有一个主服务器实现了缓存数据的实时同步，保证了从服务器上的数据的一致性。It can be seen that this application proposes a cache data synchronization method, which includes: obtaining the target cache data in the main server of the remote dictionary service cluster; the target cache data is that the application server saves the corresponding changed business data after the business data changes. The cached data obtained after reaching the main server; broadcasting the target cached data to each client of the distributed message middleware system through the server of the distributed message middleware system; different clients Corresponding to different slave servers in the remote dictionary service cluster respectively; each client that controls the distributed message middleware system transmits the target cache data obtained to the corresponding slave server respectively. , so that each slave server saves the obtained target cache data to its own local cache space. In this way, the application server in this application only connects to one master server, thus reducing the pressure on the application server. In addition, this application adds a distributed message middleware system between the master and slave servers, and uses the distributed message middleware system to process data synchronization requests from the slave servers, thus reducing the pressure on the master server. Finally, it has a broadcast sending mechanism and only one master server to achieve real-time synchronization of cached data, ensuring the consistency of data on the slave server.
进一步的，本申请实施例还提供了一种电子设备。图8是根据一示例性实施例示出的电子设备20结构图，图中的内容不能认为是对本申请的使用范围的任何限制。Further, the embodiment of the present application also provides an electronic device. FIG. 8 is a structural diagram of the electronic device 20 according to an exemplary embodiment. The content in the figure cannot be considered as any limitation on the scope of the present application.
图8为本申请实施例提供的一种电子设备20的结构示意图。该电子设备20，具体可以包括：至少一个处理器21、至少一个存储器22、显示屏23、输入输出接口24、通信接口25、电源26、和通信总线27。其中，所述存储器22用于存储计算机程序，所述计算机程序由所述处理器21加载并执行，以实现前述任一实施例公开的缓存数据同步方法中的相关步骤。另外，本实施例中的电子设备20具体可以为电子计算机。FIG. 8 is a schematic structural diagram of an electronic device 20 provided by an embodiment of the present application. The electronic device 20 may specifically include: at least one processor 21, at least one memory 22, a display screen 23, an input and output interface 24, a communication interface 25, a power supply 26, and a communication bus 27. The memory 22 is used to store a computer program, and the computer program is loaded and executed by the processor 21 to implement relevant steps in the cache data synchronization method disclosed in any of the foregoing embodiments. In addition, the electronic device 20 in this embodiment may specifically be an electronic computer.
本实施例中，电源26用于为电子设备20上的各硬件设备提供工作电压；通信接口25能够为电子设备20创建与外界设备之间的数据传输通道，其所遵循的通信协议是能够适用于本申请技术方案的任意通信协议，在此不对其进行具体限定；输入输出接口24，用于获取外界输入数据或向外界输出数据，其具体的接口类型可以根据具体应用需要进行选取，在此不进行具体限定。In this embodiment, the power supply 26 is used to provide working voltage for each hardware device on the electronic device 20; the communication interface 25 can create a data transmission channel between the electronic device 20 and external devices, and the communication protocol it follows can be applicable Any communication protocol of the technical solution of this application is not specifically limited here; the input and output interface 24 is used to obtain external input data or output data to the external world, and its specific interface type can be selected according to specific application needs. Here Not specifically limited.
另外，存储器22作为资源存储的载体，可以是只读存储器、随机存储器、磁盘或者光盘等，其上所存储的资源可以包括计算机程序221，存储方式可以是短暂存储或者永久存储。其中，计算机程序221除了包括能够用于完成前述任一实施例公开的由电子设备20执行的缓存数据同步方法的计算机程序之外，还可以进一步包括能够用于完成其他特定工作的计算机程序。In addition, the memory 22, as a carrier for resource storage, can be a read-only memory, a random access memory, a magnetic disk or an optical disk, etc. The resources stored thereon can include the computer program 221, and the storage method can be short-term storage or permanent storage. In addition to computer programs that can be used to complete the cache data synchronization method executed by the electronic device 20 disclosed in any of the foregoing embodiments, the computer program 221 may further include computer programs that can be used to complete other specific tasks.
进一步的，本申请实施例还公开了一种计算机可读存储介质，用于存储计算机程序；其中，所述计算机程序被处理器执行时实现前述公开的缓存数据同步方法。Furthermore, embodiments of the present application also disclose a computer-readable storage medium for storing a computer program; wherein when the computer program is executed by a processor, the previously disclosed cache data synchronization method is implemented.
关于该方法的具体步骤可以参考前述实施例中公开的相应内容，在此不再进行赘述。Regarding the specific steps of this method, reference may be made to the corresponding content disclosed in the foregoing embodiments, which will not be described again here.
本申请书中各个实施例采用递进的方式描述，每个实施例重点说明的都是与其它实施例的不同之处，各个实施例之间相同或相似部分互相参见即可。对于实施例公开的装置而言，由于其与实施例公开的方法相对应，所以描述的比较简单，相关之处参见方法部分说明即可。Each embodiment in this application is described in a progressive manner. Each embodiment focuses on its differences from other embodiments. The same or similar parts between the various embodiments can be referred to each other. As for the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple. For relevant details, please refer to the description in the method section.
专业人员还可以进一步意识到，结合本文中所公开的实施例描述的各示例的单元及算法步骤，能够以电子硬件、计算机软件或者二者的结合来实现，为了清楚地说明硬件和软件的可互换性，在上述说明中已经按照功能一般性地描述了各示例的组成及步骤。这些功能究竟以硬件还是软件方式来执行，取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能，但是这种实现不应认为超出本申请的范围。Those skilled in the art may further realize that the units and algorithm steps of each example described in connection with the embodiments disclosed herein can be implemented by electronic hardware, computer software, or a combination of both. In order to clearly illustrate the possible functions of hardware and software, Interchangeability, in the above description, the composition and steps of each example have been generally described according to functions. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each specific application, but such implementations should not be considered beyond the scope of this application.
结合本文中所公开的实施例描述的方法或算法的步骤可以直接用硬件、处理器执行的软件模块，或者二者的结合来实施。软件模块可以置于随机存储器(RAM)、内存、只读存储器(ROM)、电可编程ROM、电可擦除可编程ROM、寄存器、硬盘、可移动磁盘、CD-ROM、或技术领域内所公知的任意其它形式的存储介质中。The steps of the methods or algorithms described in conjunction with the embodiments disclosed herein may be implemented directly in hardware, in software modules executed by a processor, or in a combination of both. Software modules may be located in random access memory (RAM), memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disks, removable disks, CD-ROMs, or anywhere in the field of technology. any other known form of storage media.
最后，还需要说明的是，在本文中，诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来，而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。Finally, it should be noted that in this article, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that these entities or any such actual relationship or sequence between operations. Furthermore, the terms "comprises," "comprises," or any other variations thereof are intended to cover a non-exclusive inclusion such that a process, method, article, or apparatus that includes a list of elements includes not only those elements, but also those not expressly listed other elements, or elements inherent to the process, method, article or equipment. Without further limitation, an element defined by the statement "comprises a..." does not exclude the presence of additional identical elements in a process, method, article, or apparatus that includes the stated element.
以上对本申请所提供的一种缓存数据同步方法、装置、设备、存储介质进行了详细介绍，本文中应用了具体个例对本申请的原理及实施方式进行了阐述，以上实施例的说明只是用于帮助理解本申请的方法及其核心思想；同时，对于本领域的一般技术人员，依据本申请的思想，在具体实施方式及应用范围上均会有改变之处，综上所述，本说明书内容不应理解为对本申请的限制。The cache data synchronization method, device, equipment, and storage medium provided by this application have been introduced in detail above. This article uses specific examples to illustrate the principles and implementation methods of this application. The description of the above embodiments is only for It helps to understand the methods and core ideas of this application; at the same time, for those of ordinary skill in the field, there will be changes in the specific implementation methods and application scope based on the ideas of this application. In summary, the content of this specification It should not be construed as a limitation on this application.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111445506.XACN114328618B (en) | 2021-11-30 | 2021-11-30 | A cache data synchronization method, device, equipment and storage medium |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111445506.XACN114328618B (en) | 2021-11-30 | 2021-11-30 | A cache data synchronization method, device, equipment and storage medium |
| Publication Number | Publication Date |
|---|---|
| CN114328618A CN114328618A (en) | 2022-04-12 |
| CN114328618Btrue CN114328618B (en) | 2024-02-09 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111445506.XAActiveCN114328618B (en) | 2021-11-30 | 2021-11-30 | A cache data synchronization method, device, equipment and storage medium |
| Country | Link |
|---|---|
| CN (1) | CN114328618B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114675987A (en)* | 2022-04-18 | 2022-06-28 | 北京高途云集教育科技有限公司 | Cache data processing method and device, computer equipment and storage medium |
| CN114547511B (en)* | 2022-04-27 | 2022-07-19 | 成都瑞华康源科技有限公司 | Method and system for using system data dictionary based on Internet of Things MQTT protocol |
| CN114780643B (en)* | 2022-06-16 | 2022-10-21 | 恒生电子股份有限公司 | Data synchronization processing method and device, electronic equipment and readable storage medium |
| CN115118590B (en)* | 2022-06-22 | 2024-05-10 | 平安科技（深圳）有限公司 | Method, device, system, equipment and storage medium for managing configuration data |
| CN115412603B (en)* | 2022-11-02 | 2022-12-27 | 中国电子科技集团公司第十五研究所 | High-availability method and device for message client module of message middleware |
| CN115858582A (en)* | 2022-11-24 | 2023-03-28 | 杭州安恒车联网安全技术有限公司 | Cache real-time updating method, device, equipment and storage medium |
| CN115883087A (en)* | 2022-12-21 | 2023-03-31 | 中国建设银行股份有限公司 | Key updating method, device, equipment and medium based on server cluster |
| CN116112509B (en)* | 2022-12-29 | 2024-12-24 | 中国电信股份有限公司 | Data synchronization method and device, electronic equipment and storage medium |
| CN116010501A (en)* | 2022-12-30 | 2023-04-25 | 百果园技术(新加坡)有限公司 | Distributed medium-level data processing method, system, device, storage medium and program product |
| CN116938961B (en)* | 2023-09-15 | 2024-03-01 | 北京趋动智能科技有限公司 | System and method for data synchronization and data reading method |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105893543A (en)* | 2016-03-31 | 2016-08-24 | 微梦创科网络科技（中国）有限公司 | Data buffer service method and system |
| CN110633320A (en)* | 2018-05-30 | 2019-12-31 | 北京京东尚科信息技术有限公司 | Processing method, system, equipment and storage medium of distributed data service |
| CN113010549A (en)* | 2021-01-29 | 2021-06-22 | 腾讯科技（深圳）有限公司 | Data processing method based on remote multi-active system, related equipment and storage medium |
| CN113157466A (en)* | 2021-04-27 | 2021-07-23 | 上海销氪信息科技有限公司 | Message pushing method, device, system, electronic equipment and storage medium |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8495250B2 (en)* | 2009-12-16 | 2013-07-23 | International Business Machines Corporation | Asynchronous file operations in a scalable multi-node file system cache for a remote cluster file system |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105893543A (en)* | 2016-03-31 | 2016-08-24 | 微梦创科网络科技（中国）有限公司 | Data buffer service method and system |
| CN110633320A (en)* | 2018-05-30 | 2019-12-31 | 北京京东尚科信息技术有限公司 | Processing method, system, equipment and storage medium of distributed data service |
| CN113010549A (en)* | 2021-01-29 | 2021-06-22 | 腾讯科技（深圳）有限公司 | Data processing method based on remote multi-active system, related equipment and storage medium |
| CN113157466A (en)* | 2021-04-27 | 2021-07-23 | 上海销氪信息科技有限公司 | Message pushing method, device, system, electronic equipment and storage medium |
| Publication number | Publication date |
|---|---|
| CN114328618A (en) | 2022-04-12 |
| Publication | Publication Date | Title |
|---|---|---|
| CN114328618B (en) | A cache data synchronization method, device, equipment and storage medium | |
| US10069942B2 (en) | Method and apparatus for changing configurations | |
| CN107295080A (en) | Date storage method and server applied to distributed server cluster | |
| WO2021121370A1 (en) | Message loss detection method and apparatus for message queue | |
| CN112118315A (en) | Data processing system, method, apparatus, electronic device and storage medium | |
| CN112711635B (en) | Method for cross-regional data consistency of distributed Internet of things equipment and service cluster | |
| CN107861686A (en) | File memory method, service end and computer-readable recording medium | |
| JP2017037666A (en) | Send category information | |
| CN107888666B (en) | Cross-region data storage system and data synchronization method and device | |
| WO2012151993A1 (en) | Service pushing method and device | |
| CN114448686B (en) | Cross-network communication device and method based on micro-service | |
| US8775456B2 (en) | System and method for scheduled and collaborative distribution of software and data to many thousands of clients over a network using dynamic virtual proxies | |
| CN112838935B (en) | Electronic data exchange method and system | |
| CN114827171B (en) | Information synchronization method, apparatus, computer device and storage medium | |
| CN115629909A (en) | Service data processing method and device, electronic equipment and storage medium | |
| CN115189931A (en) | Distributed key management method, device, equipment and storage medium | |
| CN113301088B (en) | Message processing method, device and system, electronic equipment and readable storage medium | |
| US20240015135A1 (en) | Domain management and synchronization system | |
| JP2011527783A (en) | Adapter for synchronizing data on different networks | |
| CN110750369A (en) | A distributed node management method and system | |
| WO2012046585A1 (en) | Distributed storage system, method of controlling same, and program | |
| CN115454666A (en) | Data synchronization method and device among message queue clusters | |
| CN110417850B (en) | Software configuration acquisition method, system, server and medium | |
| CN107306290A (en) | A kind of session session sharing methods and application server | |
| CN114500485B (en) | Data processing method and device |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address | Address after:Building 9, No.1, guanpu Road, Guoxiang street, Wuzhong Economic Development Zone, Wuzhong District, Suzhou City, Jiangsu Province Patentee after:Suzhou Yuannao Intelligent Technology Co.,Ltd. Country or region after:China Address before:Building 9, No.1, guanpu Road, Guoxiang street, Wuzhong Economic Development Zone, Wuzhong District, Suzhou City, Jiangsu Province Patentee before:SUZHOU LANGCHAO INTELLIGENT TECHNOLOGY Co.,Ltd. Country or region before:China |