技术领域technical field
本发明涉及元数据技术领域，特别是涉及一种元数据集群目录调度的方法以及装置。The present invention relates to the technical field of metadata, in particular to a method and device for scheduling metadata cluster directories.
背景技术Background technique
随着海量文件应用的增多，越来越多的非结构文件需要存储，而元数据目录就是其中的一种。With the increase in the application of massive files, more and more unstructured files need to be stored, and the metadata directory is one of them.
元数据可以是指数据的数据，即描述数据的具体信息，例如文件的名称、大小、日期、属性、扩展属性等。目录和文件都有元数据，目录的元数据更多管理树形层次以及所包含的子目录、文件。而元数据的管理主要是基于元数据服务，可以将多个元数据服务管理成一个集群，形成元数据集群。Metadata can refer to the data of the data, that is, specific information describing the data, such as the name, size, date, attributes, and extended attributes of the file. Both directories and files have metadata, and the metadata of directories is more about managing the tree hierarchy and the subdirectories and files it contains. Metadata management is mainly based on metadata services, and multiple metadata services can be managed into a cluster to form a metadata cluster.
目前，元数据集群性能提升和负载主要是元数据集群静态子树分区和元数据集群动态子树分区，其都是利用目录树的逻辑独立性进行负载，以实现性能的线性扩展。但是，这种方式不能实现单目录性能的扩展，无法解决单目录元数据性能问题，即当大量元数据请求落入单一目录内时，由于单目录不能像子目录树一样进行负载，导致单目录的元数据性能较低。故如何提高单目录元数据性能的问题是本领域亟待解决的问题。At present, the performance improvement and load of metadata clusters are mainly the static subtree partition of metadata cluster and the dynamic subtree partition of metadata cluster. Both of them use the logical independence of the directory tree for load to achieve linear expansion of performance. However, this method cannot achieve the expansion of single-directory performance, and cannot solve the problem of single-directory metadata performance, that is, when a large number of metadata requests fall into a single directory, because the single directory cannot be loaded like a subdirectory tree, resulting in Metadata performance is low. Therefore, how to improve the performance of single-directory metadata is an urgent problem to be solved in this field.
发明内容Contents of the invention
本发明的目的是提供一种元数据集群目录调度的方法以及装置，目的在于解决现有技术中单目录元数据性能较低的问题。The purpose of the present invention is to provide a method and device for scheduling metadata cluster directories, aiming at solving the problem of low performance of single directory metadata in the prior art.
为解决上述技术问题，本发明提供一种元数据集群目录调度的方法，该方法包括：In order to solve the above technical problems, the present invention provides a method for scheduling metadata cluster directories, the method comprising:
获取包含目录项名称的多个元数据请求；Get multiple metadata requests containing catalog item names;
根据所述目录项名称，通过预设方式寻找到相应的预先对单目录进行划分操作得到的子目录片段；According to the name of the directory item, find the corresponding subdirectory fragment obtained by dividing the single directory in advance through a preset method;
根据所述子目录片段的信息，将所述元数据请求分发至相应的元数据服务，以使相应的所述元数据服务对多个所述元数据请求进行并发处理。According to the information of the subdirectory segment, the metadata request is distributed to the corresponding metadata service, so that the corresponding metadata service can concurrently process the multiple metadata requests.
可选地，所述根据所述子目录片段的信息，将所述元数据请求分发至相应的元数据服务，以使相应的所述元数据服务对多个所述元数据请求进行并发处理包括：Optionally, the distributing the metadata request to the corresponding metadata service according to the information of the subdirectory fragment, so that the corresponding metadata service performs concurrent processing on multiple metadata requests includes :
根据所述子目录片段的标识信息，以及与所述子目录片段预绑定的元数据服务信息，寻找到相应的所述元数据服务；Finding the corresponding metadata service according to the identification information of the subdirectory fragment and the metadata service information pre-bound with the subdirectory fragment;
将所述元数据请求发送至相应的所述元数据服务。sending the metadata request to the corresponding metadata service.
可选地，所述根据所述目录项名称，通过预设方式寻找到相应的预先对单目录进行划分操作得到的子目录片段包括：Optionally, according to the name of the directory entry, searching for the corresponding subdirectory fragment obtained by pre-dividing the single directory through a preset method includes:
根据所述目录项名称，利用哈希计算寻找到相应的预先对单目录进行划分操作得到的子目录片段。According to the name of the directory item, the hash calculation is used to find the corresponding subdirectory fragment obtained by dividing the single directory in advance.
可选地，在所述获取包含目录项名称的多个元数据请求之前还包括：Optionally, before the acquisition of multiple metadata requests including directory item names, the method further includes:
接收目录创建请求；Receive directory creation request;
根据所述目录创建请求以及元数据集群内的元数据服务个数，将所述单目录划分为预设数量的所述子目录片段；Divide the single directory into a preset number of subdirectory segments according to the directory creation request and the number of metadata services in the metadata cluster;
将各个所述子目录片段与相应的元数据服务进行绑定。Bind each of the subdirectory fragments with the corresponding metadata service.
可选地，在所述根据所述创建请求以及元数据集群内的元数据服务个数，将所述单目录划分为预设数量的所述子目录片段，之后还包括：Optionally, after dividing the single directory into a preset number of subdirectory segments according to the creation request and the number of metadata services in the metadata cluster, the method further includes:
将所述子目录片段的字符名称设为哈希，以实现各个所述子目录片段的独立命名空间、相对逻辑独立以及信息独立统计。The character names of the subdirectory fragments are set as hashes, so as to realize independent namespace, relative logic independence and independent information statistics of each subdirectory fragment.
此外，本发明还提供了一种元数据集群目录调度的装置，该装置包括：In addition, the present invention also provides a metadata cluster directory scheduling device, which includes:
获取模块，用于获取包含目录项名称的多个元数据请求；A fetch module for fetching multiple metadata requests including catalog item names;
寻找模块，用于根据所述目录项名称，通过预设方式寻找到相应的预先对单目录进行划分操作得到的子目录片段；A search module, configured to find corresponding subdirectory fragments obtained by pre-dividing a single directory in a preset manner according to the name of the directory item;
并发处理模块，用于根据所述子目录片段的信息，将所述元数据请求分发至相应的元数据服务，以使相应的所述元数据服务对多个所述元数据请求进行并发处理。The concurrent processing module is configured to distribute the metadata requests to corresponding metadata services according to the information of the subdirectory fragments, so that the corresponding metadata services can process multiple metadata requests concurrently.
可选地，所述并发处理模块包括：Optionally, the concurrent processing module includes:
寻找单元，用于根据所述子目录片段的标识信息，以及与所述子目录片段预绑定的元数据服务信息，寻找到所述元数据服务；A searching unit, configured to find the metadata service according to the identification information of the subdirectory fragment and the metadata service information pre-bound with the subdirectory fragment;
发送单元，用于将所述元数据请求发送至所述元数据服务。A sending unit, configured to send the metadata request to the metadata service.
可选地，所述寻找模块包括：Optionally, the search module includes:
哈希寻找单元，用于根据所述目录项名称，利用哈希计算寻找到相应的预先对单目录进行划分操作得到的子目录片段。The hash search unit is configured to use hash calculation to find the corresponding subdirectory fragments obtained by dividing the single directory in advance according to the directory entry name.
可选地，还包括：Optionally, also include:
接收模块，用于接收目录创建请求；A receiving module, configured to receive a directory creation request;
划分模块，用于根据所述目录创建请求以及元数据集群内的元数据服务个数，将所述单目录划分为预设数量的所述子目录片段；A division module, configured to divide the single directory into a preset number of subdirectory fragments according to the directory creation request and the number of metadata services in the metadata cluster;
绑定模块，用于将各个所述子目录片段与相应的元数据服务进行绑定。A binding module, configured to bind each subdirectory segment with a corresponding metadata service.
可选地，还包括：Optionally, also include:
字符名称设定模块，用于将所述子目录片段的字符名称设为哈希，以实现各个所述子目录片段的独立命名空间、相对逻辑独立以及信息独立统计。The character name setting module is used to set the character name of the subdirectory fragments as a hash, so as to realize independent namespace, relative logic independence and independent information statistics of each subdirectory fragment.
本发明所提供的一种元数据集群目录调度的方法以及装置，通过获取包含目录项名称的多个元数据请求；根据上述目录项名称，通过预设方式寻找到相应的预先对单目录进行划分操作得到的子目录片段；根据上述子目录片段的信息，将上述元数据请求分发至相应的元数据服务，以使相应的上述元数据服务对多个上述元数据请求进行并发处理。将目录预先划分为多个子目录片段，再将多个子目录片段并发负载到元数据集群，即将多个元数据请求，根据所包含的信息调度至对应元数据服务，多个元数据服务可以组成元数据集群，使得元数据集群可以并发处理多个元数据请求，以实现单目录并发。可见，本申请有利于提高单目录元数据性能。A method and device for metadata cluster directory scheduling provided by the present invention obtain multiple metadata requests including directory item names; according to the above directory item names, find corresponding pre-divided single directories in a preset manner Operating the obtained subdirectory fragments; according to the information of the above subdirectory fragments, distributing the above metadata requests to corresponding metadata services, so that the corresponding above metadata services can concurrently process multiple above metadata requests. The directory is pre-divided into multiple subdirectory fragments, and then the multiple subdirectory fragments are concurrently loaded to the metadata cluster, that is, multiple metadata requests are dispatched to the corresponding metadata services according to the information contained, and multiple metadata services can form a metadata cluster. The data cluster enables the metadata cluster to process multiple metadata requests concurrently to achieve single-directory concurrency. It can be seen that the present application is beneficial to improving the performance of single-directory metadata.
附图说明Description of drawings
为了更清楚的说明本发明实施例或现有技术的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单的介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。In order to more clearly illustrate the embodiments of the present invention or the technical solutions of the prior art, the following will briefly introduce the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only For some embodiments of the present invention, those skilled in the art can also obtain other drawings based on these drawings without creative work.
图1为本发明实施例所提供的元数据集群目录调度方法的一种具体实施方式的流程示意图；FIG. 1 is a schematic flow diagram of a specific implementation of the metadata cluster directory scheduling method provided by the embodiment of the present invention;
图2为本发明实施例所提供的元数据集群目录调度装置的结构框图。Fig. 2 is a structural block diagram of a metadata cluster directory scheduling device provided by an embodiment of the present invention.
具体实施方式detailed description
为了使本技术领域的人员更好地理解本发明方案，下面结合附图和具体实施方式对本发明作进一步的详细说明。显然，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。In order to enable those skilled in the art to better understand the solution of the present invention, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. Apparently, the described embodiments are only some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.
请参见图1，图1为本发明实施例所提供的元数据集群目录调度方法的一种具体实施方式的流程示意图，该方法包括以下步骤：Please refer to FIG. 1. FIG. 1 is a schematic flowchart of a specific implementation method of a metadata cluster directory scheduling method provided by an embodiment of the present invention. The method includes the following steps:
步骤101：获取包含目录项名称的多个元数据请求；Step 101: Obtain multiple metadata requests including directory item names;
需要说明的是，上述元数据请求应包含相应的目录项名称，当然，各个元数据请求所包含的目录项名称可以是相同的，也可以是不相同的。It should be noted that the above metadata requests should include corresponding directory item names, of course, the directory item names included in each metadata request may be the same or different.
在本发明的一些实施例中，在获取包含目录项名称的多个元数据请求之前还可以包括：接收目录创建请求；根据所述目录创建请求以及元数据集群内的元数据服务个数，将所述单目录划分为预设数量的所述子目录片段；将各个所述子目录片段与相应的元数据服务进行绑定。In some embodiments of the present invention, before obtaining multiple metadata requests including the name of the directory item, it may further include: receiving a directory creation request; according to the directory creation request and the number of metadata services in the metadata cluster, the The single directory is divided into a preset number of subdirectory segments; each subdirectory segment is bound to a corresponding metadata service.
可以理解的是，上述目录创建请求可以是指用户输入的创建指令。接收到目录创建请求后，可以对目录进行分片，即将目录划分为多个子目录片段。而子目录片段的个数可以由当前元数据集群内的元数据服务个数来决定，即上述预设数量的数值可以有当前元数据集群的状态决定，也即可以根据当前元数据集群内的元数据服务模块的个数的多少，来决定创建多少个子目录片段。当然，子目录片段的个数还可以由用户指定，即用户可以在创建目录时，限定所需创建的子目录片段个数。It can be understood that the above directory creation request may refer to a creation instruction input by the user. After receiving the directory creation request, the directory can be fragmented, that is, the directory is divided into multiple subdirectory fragments. The number of subdirectory fragments can be determined by the number of metadata services in the current metadata cluster, that is, the value of the above preset number can be determined by the status of the current metadata cluster, that is, it can be determined according to the number of metadata services in the current metadata cluster. The number of metadata service modules determines how many subdirectory fragments to create. Of course, the number of subdirectory fragments can also be specified by the user, that is, the user can limit the number of subdirectory fragments to be created when creating a directory.
在将目录划分为多个子目录片段之后，即在创建相应数量的分片之后，可以将各个子目录片段与相应的元数据服务模块进行绑定，即将子目录片段负载到对应的元数据服务模块。After the directory is divided into multiple subdirectory fragments, that is, after a corresponding number of fragments are created, each subdirectory fragment can be bound to the corresponding metadata service module, that is, the subdirectory fragment is loaded to the corresponding metadata service module .
可以理解的是，一个元数据服务可以对应一个子目录片段，即每个元数据服务只能负载一个分片。It is understandable that a metadata service can correspond to a subdirectory fragment, that is, each metadata service can only load one fragment.
为了实现各个元数据服务可以并发处理元数据请求，需要实现各个子目录片段的逻辑独立，在本发明的一些实施例中，其过程可以具体为：将所述子目录片段的字符名称设为哈希，以实现各个所述子目录片段的独立命名空间、相对逻辑独立以及信息独立统计。In order to realize that each metadata service can process metadata requests concurrently, it is necessary to realize the logical independence of each subdirectory segment. In some embodiments of the present invention, the process may specifically be: set the character name of the subdirectory segment to hash In order to realize the independent namespace, relative logical independence and independent statistics of information of each of the subdirectory fragments.
需要说明的是，将子目录片段的名称设为哈希，可以将目录名称先累积成一个固定长度的数字，再对该数字进行哈希计算。而哈希计算为本领域技术人员所熟知的技术，在此不再赘述。It should be noted that, if the name of the subdirectory segment is set as a hash, the directory name can be accumulated into a fixed-length number first, and then the hash calculation is performed on the number. Hash calculation is a technology well known to those skilled in the art, and will not be repeated here.
步骤102：根据所述目录项名称，通过预设方式寻找到相应的预先对单目录进行划分操作得到的子目录片段；Step 102: According to the name of the directory item, find the corresponding subdirectory fragment obtained by dividing the single directory in advance through a preset method;
具体地，可以根据元数据请求所包含的目录项名称，确定该元数据请求对应的子目录片段。Specifically, the subdirectory segment corresponding to the metadata request may be determined according to the name of the directory item included in the metadata request.
在本发明的一些实施例中，可以通过哈希方式来寻找相应的子目录片段，其过程可以具体为：根据所述目录项名称，利用哈希计算寻找到相应的预先对单目录进行划分操作得到的子目录片段。In some embodiments of the present invention, the corresponding subdirectory fragments can be found by means of hashing, and the process can be specifically: according to the name of the directory item, use hash calculation to find the corresponding pre-divided single directory Get the subdirectory snippet.
需要说明的是，通过哈希计算寻找子目录片段是本领域技术人员所熟知的技术，在此不再赘述。It should be noted that searching for subdirectory fragments through hash calculation is a technology well known to those skilled in the art, and will not be repeated here.
步骤103：根据所述子目录片段的信息，将所述元数据请求分发至相应的元数据服务，以使相应的所述元数据服务对多个所述元数据请求进行并发处理。Step 103: Distribute the metadata request to a corresponding metadata service according to the information of the subdirectory fragment, so that the corresponding metadata service can process multiple metadata requests concurrently.
具体地，通过子目录片段的信息，即分片信息，确定分片对应的元数据服务，以将元数据请求发送至相应的元数据服务，这样，元数据服务则可以同时对多个元数据请求进行并发处理，即实现并发调度。Specifically, the metadata service corresponding to the fragment is determined through the subdirectory fragment information, that is, the fragment information, so as to send the metadata request to the corresponding metadata service. In this way, the metadata service can simultaneously process multiple metadata Requests are processed concurrently, that is, concurrent scheduling is implemented.
在本发明的一些实施例中，将元数据请求传输至相应的元数据服务的过程可以具体为:根据所述子目录片段的标识信息，以及与所述子目录片段预绑定的元数据服务信息，寻找到相应的所述元数据服务；将所述元数据请求发送至相应的所述元数据服务。In some embodiments of the present invention, the process of transmitting the metadata request to the corresponding metadata service may be specifically: according to the identification information of the subdirectory fragment, and the metadata service pre-bound with the subdirectory fragment information, find the corresponding metadata service; and send the metadata request to the corresponding metadata service.
可以理解的是，上述标识信息以及元数据服务信息可以是指在创建分片，与相应元数据服务绑定时的相关信息，通过该信息可以确定出元数据请求对应的元数据服务。It can be understood that the above-mentioned identification information and metadata service information may refer to relevant information when a fragment is created and bound to a corresponding metadata service, and the metadata service corresponding to the metadata request can be determined through this information.
本发明实施例所提供的元数据集群目录调度的方法，通过获取包含目录项名称的多个元数据请求；根据上述目录项名称，通过预设方式寻找到相应的预先对单目录进行划分操作得到的子目录片段；根据上述子目录片段的信息，将上述元数据请求分发至相应的元数据服务，以使相应的上述元数据服务对多个上述元数据请求进行并发处理。将目录预先划分为多个子目录片段，再将多个子目录片段并发负载到元数据集群，即将多个元数据请求，根据所包含的信息调度至对应元数据服务，多个元数据服务可以组成元数据集群，使得元数据集群可以并发处理多个元数据请求，以发挥元数据集群目录处理性能的横向扩展。可见，该方法有利于提高单目录元数据性能。The metadata cluster directory scheduling method provided by the embodiment of the present invention obtains multiple metadata requests containing directory item names; according to the above directory item names, finds the corresponding pre-divided single directory through a preset method to obtain subdirectory fragments; according to the information of the subdirectory fragments, distribute the metadata requests to the corresponding metadata services, so that the corresponding metadata services can process multiple metadata requests concurrently. The directory is pre-divided into multiple subdirectory fragments, and then the multiple subdirectory fragments are concurrently loaded to the metadata cluster, that is, multiple metadata requests are dispatched to the corresponding metadata services according to the information contained, and multiple metadata services can form a metadata cluster. The data cluster enables the metadata cluster to process multiple metadata requests concurrently, so as to maximize the horizontal expansion of the metadata cluster directory processing performance. It can be seen that this method is beneficial to improve the performance of single-directory metadata.
下面对本发明实施例提供的元数据集群目录调度装置进行介绍，下文描述的元数据集群目录调度装置与上文描述的元数据集群目录调度方法可相互对应参照。The following is an introduction to the metadata cluster directory scheduling device provided by the embodiment of the present invention. The metadata cluster directory scheduling device described below and the metadata cluster directory scheduling method described above may refer to each other correspondingly.
图2为本发明实施例所提供的元数据集群目录调度装置的结构框图，参照图2元数据集群目录调度装置可以包括：FIG. 2 is a structural block diagram of a metadata cluster directory scheduling device provided by an embodiment of the present invention. Referring to FIG. 2, the metadata cluster directory scheduling device may include:
获取模块201，用于获取包含目录项名称的多个元数据请求；An acquisition module 201, configured to acquire multiple metadata requests including directory item names;
寻找模块202，用于根据所述目录项名称，通过预设方式寻找到相应的预先对单目录进行划分操作得到的子目录片段；The searching module 202 is configured to find corresponding subdirectory fragments obtained by pre-dividing a single directory in a preset manner according to the name of the directory item;
并发处理模块203，用于根据所述子目录片段的信息，将所述元数据请求分发至相应的元数据服务，以使相应的所述元数据服务对多个所述元数据请求进行并发处理。The concurrent processing module 203 is configured to distribute the metadata request to the corresponding metadata service according to the information of the subdirectory fragment, so that the corresponding metadata service can concurrently process multiple metadata requests .
可选地，所述并发处理模块包括：Optionally, the concurrent processing module includes:
寻找单元，用于根据所述子目录片段的标识信息，以及与所述子目录片段预绑定的元数据服务信息，寻找到所述元数据服务；A searching unit, configured to find the metadata service according to the identification information of the subdirectory fragment and the metadata service information pre-bound with the subdirectory fragment;
发送单元，用于将所述元数据请求发送至所述元数据服务。A sending unit, configured to send the metadata request to the metadata service.
可选地，所述寻找模块包括：Optionally, the search module includes:
哈希寻找单元，用于根据所述目录项名称，利用哈希计算寻找到相应的预先对单目录进行划分操作得到的子目录片段。The hash search unit is configured to use hash calculation to find the corresponding subdirectory fragments obtained by dividing the single directory in advance according to the directory entry name.
可选地，还包括：Optionally, also include:
接收模块，用于接收目录创建请求；A receiving module, configured to receive a directory creation request;
划分模块，用于根据所述目录创建请求以及元数据集群内的元数据服务个数，将所述单目录划分为预设数量的所述子目录片段；A division module, configured to divide the single directory into a preset number of subdirectory fragments according to the directory creation request and the number of metadata services in the metadata cluster;
绑定模块，用于将各个所述子目录片段与相应的元数据服务进行绑定。A binding module, configured to bind each subdirectory segment with a corresponding metadata service.
可选地，还包括：Optionally, also include:
字符名称设定模块，用于将所述子目录片段的字符名称设为哈希，以实现各个所述子目录片段的独立命名空间、相对逻辑独立以及信息独立统计。The character name setting module is used to set the character name of the subdirectory fragments as a hash, so as to realize independent namespace, relative logic independence and independent information statistics of each subdirectory fragment.
本发明实施例所提供的元数据集群目录调度的装置，将目录预先划分为多个子目录片段，再将多个子目录片段并发负载到元数据集群，即将多个元数据请求，根据所包含的信息调度至对应元数据服务，多个元数据服务可以组成元数据集群，使得元数据集群可以并发处理多个元数据请求，以发挥元数据集群目录处理性能的横向扩展。可见，该装置有利于提高单目录元数据性能。The metadata cluster directory scheduling device provided by the embodiment of the present invention divides the directory into multiple subdirectory fragments in advance, and then concurrently loads the multiple subdirectory fragments to the metadata cluster, that is, multiple metadata requests, according to the included information Scheduling to the corresponding metadata service, multiple metadata services can form a metadata cluster, so that the metadata cluster can process multiple metadata requests concurrently, so as to maximize the horizontal expansion of the metadata cluster directory processing performance. It can be seen that the device is beneficial to improve the performance of single-directory metadata.
本说明书中各个实施例采用递进的方式描述，每个实施例重点说明的都是与其它实施例的不同之处，各个实施例之间相同或相似部分互相参见即可。对于实施例公开的装置而言，由于其与实施例公开的方法相对应，所以描述的比较简单，相关之处参见方法部分说明即可。Each embodiment in this specification is described in a progressive manner, each embodiment focuses on the difference from other embodiments, and the same or similar parts of each embodiment can be referred to each other. As for the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and for the related information, please refer to the description of the method part.
专业人员还可以进一步意识到，结合本文中所公开的实施例描述的各示例的单元及算法步骤，能够以电子硬件、计算机软件或者二者的结合来实现，为了清楚地说明硬件和软件的可互换性，在上述说明中已经按照功能一般性地描述了各示例的组成及步骤。这些功能究竟以硬件还是软件方式来执行，取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能，但是这种实现不应认为超出本发明的范围。Professionals can further realize that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, computer software or a combination of the two. In order to clearly illustrate the possible For interchangeability, in the above description, the composition and steps of each example have been generally described according to their functions. Whether these functions are executed by hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present invention.
结合本文中所公开的实施例描述的方法或算法的步骤可以直接用硬件、处理器执行的软件模块，或者二者的结合来实施。软件模块可以置于随机存储器(RAM)、内存、只读存储器(ROM)、电可编程ROM、电可擦除可编程ROM、寄存器、硬盘、可移动磁盘、CD-ROM、或技术领域内所公知的任意其它形式的存储介质中。The steps of the methods or algorithms described in conjunction with the embodiments disclosed herein may be directly implemented by hardware, software modules executed by a processor, or a combination of both. Software modules can be placed in random access memory (RAM), internal memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or any other Any other known storage medium.
以上对本发明所提供的元数据集群目录调度的方法以及装置进行了详细介绍。本文中应用了具体个例对本发明的原理及实施方式进行了阐述，以上实施例的说明只是用于帮助理解本发明的方法及其核心思想。应当指出，对于本技术领域的普通技术人员来说，在不脱离本发明原理的前提下，还可以对本发明进行若干改进和修饰，这些改进和修饰也落入本发明权利要求的保护范围内。The method and device for scheduling metadata cluster directories provided by the present invention have been introduced in detail above. In this paper, specific examples are used to illustrate the principle and implementation of the present invention, and the descriptions of the above embodiments are only used to help understand the method and core idea of the present invention. It should be pointed out that for those skilled in the art, without departing from the principle of the present invention, some improvements and modifications can be made to the present invention, and these improvements and modifications also fall within the protection scope of the claims of the present invention.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710113029.4ACN106775994A (en) | 2017-02-28 | 2017-02-28 | The method and device of a kind of metadata cluster catalogue scheduling |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710113029.4ACN106775994A (en) | 2017-02-28 | 2017-02-28 | The method and device of a kind of metadata cluster catalogue scheduling |
| Publication Number | Publication Date |
|---|---|
| CN106775994Atrue CN106775994A (en) | 2017-05-31 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710113029.4APendingCN106775994A (en) | 2017-02-28 | 2017-02-28 | The method and device of a kind of metadata cluster catalogue scheduling |
| Country | Link |
|---|---|
| CN (1) | CN106775994A (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107729495A (en)* | 2017-10-18 | 2018-02-23 | 郑州云海信息技术有限公司 | A kind of file metadata browsing method and device |
| CN110389940A (en)* | 2019-07-19 | 2019-10-29 | 苏州浪潮智能科技有限公司 | A data equalization method, device and computer-readable storage medium |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101697168A (en)* | 2009-10-22 | 2010-04-21 | 中国科学技术大学 | Method and system for dynamically managing metadata of distributed file system |
| CN102541985A (en)* | 2011-10-25 | 2012-07-04 | 曙光信息产业(北京)有限公司 | Organization method of client directory cache in distributed file system |
| CN103136338A (en)* | 2013-02-04 | 2013-06-05 | 中国科学院信息工程研究所 | Metadata distribution method and device based on directory partition |
| US20140244626A1 (en)* | 2006-04-28 | 2014-08-28 | Disney Enterprises, Inc. | System and/or Method for Distributing Media Content |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140244626A1 (en)* | 2006-04-28 | 2014-08-28 | Disney Enterprises, Inc. | System and/or Method for Distributing Media Content |
| CN101697168A (en)* | 2009-10-22 | 2010-04-21 | 中国科学技术大学 | Method and system for dynamically managing metadata of distributed file system |
| CN102541985A (en)* | 2011-10-25 | 2012-07-04 | 曙光信息产业(北京)有限公司 | Organization method of client directory cache in distributed file system |
| CN103136338A (en)* | 2013-02-04 | 2013-06-05 | 中国科学院信息工程研究所 | Metadata distribution method and device based on directory partition |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107729495A (en)* | 2017-10-18 | 2018-02-23 | 郑州云海信息技术有限公司 | A kind of file metadata browsing method and device |
| CN110389940A (en)* | 2019-07-19 | 2019-10-29 | 苏州浪潮智能科技有限公司 | A data equalization method, device and computer-readable storage medium |
| CN110389940B (en)* | 2019-07-19 | 2022-02-18 | 苏州浪潮智能科技有限公司 | Data equalization method and device and computer readable storage medium |
| Publication | Publication Date | Title |
|---|---|---|
| US11238098B2 (en) | Heterogenous key-value sets in tree database | |
| US10417203B2 (en) | Compacting data history files | |
| KR101994021B1 (en) | File manipulation method and apparatus | |
| US9672233B2 (en) | Integrated search for shared storage using index throttling to maintain quality of service | |
| JP6088506B2 (en) | Managing data storage for range-based searches | |
| CN103229173B (en) | Metadata management method and system | |
| US8682874B2 (en) | Information processing system | |
| CN104881466B (en) | The processing of data fragmentation and the delet method of garbage files and device | |
| AU2013210018B2 (en) | Location independent files | |
| US9372880B2 (en) | Reclamation of empty pages in database tables | |
| US20130191523A1 (en) | Real-time analytics for large data sets | |
| JP2021500649A (en) | Computer implementation methods, computer program products, and systems for storing records in shard database shard tables, computer implementation methods, computer program products, and systems for retrieving records from shard database shard tables. System, as well as a system for storing shard databases | |
| US9195611B2 (en) | Efficiently updating and deleting data in a data storage system | |
| CN110347651A (en) | Method of data synchronization, device, equipment and storage medium based on cloud storage | |
| US20220342888A1 (en) | Object tagging | |
| US10515055B2 (en) | Mapping logical identifiers using multiple identifier spaces | |
| US20140059094A1 (en) | Making use of a file path to determine file locality for applications | |
| CN108228799A (en) | The storage method and device of object indexing information | |
| CN106471501A (en) | Data query method, data object storage method and data system | |
| US9201889B1 (en) | Integrated search for shared storage | |
| US9734171B2 (en) | Intelligent redistribution of data in a database | |
| CN115623008B (en) | An index construction method and system for Kubernetes resources | |
| CN106775994A (en) | The method and device of a kind of metadata cluster catalogue scheduling | |
| CN113095778A (en) | Architecture for managing mass data in communication application through multiple mailboxes | |
| CN106407322A (en) | Quick file searching method based on Android system |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | Application publication date:20170531 | |
| RJ01 | Rejection of invention patent application after publication |