Data access method and deviceTechnical field
The present invention relates to database application technical field more particularly to a kind of data access methods and device.
Background technique
With the continuous development of Internet technology, various abundant in content, interactive websites strong, operation is more personalized andApplication program is come into being.And the database that these websites and application program are required to rear end provides corresponding content support.
Current database technology is based on centralized database, that is, in whole system, only one database exists, instituteSome data are all stored in this database.All users pass through unique database and complete data access process.
However, above-mentioned database operating pressure is larger, it will lead to operating lag or even delay machine and stop servicing.
Summary of the invention
The present invention provides a kind of data access method and device, presses in the prior art because centralized database is run to solveThe problem that power is big and causes performance not high.
In a first aspect, the present invention provides a kind of data access method, comprising:
The data access request for carrying business major key is received, the business major key is for identifying the data access requestThe service data object to be accessed, the data access request include: to the inquiry request of the service data object, insertionRequest, removal request or update request in any one；
According to the business major key, the corresponding data point library of the service data object is determined；
The corresponding operational order of the data access request is executed on the data point library.
Optionally, described according to the business major key, determine the corresponding data point library of the service data object, comprising:
It whether there is the business major key in inquiry business major key routing table, the business major key routing table is used to indicate:The business major key of each service data object and the data of each service data object of storage divide the corresponding relationship between library；
If there are the business major key in the business major key routing table, by the business major key routing table with it is describedLibrary is divided as the data in the corresponding data point library of business major key.
Optionally, the data access method, further includes:
If the business major key is not present in the business major key routing table, the business is determined using preset algorithmThe corresponding data of major key divide library, and the corresponding relationship of the business major key and the data point library is added to the business major keyIn routing table.
It is optionally, described that the corresponding data point library of the business major key is determined using preset algorithm, comprising:
The data for searching business major key minimum number from all data point libraries divide library；
Divide library for the data point library of the business major key minimum number as the corresponding data of the business major key.
Optionally, after the step of determining the service data object corresponding data point library, the data access sideMethod further include:
The counting of business major key corresponding to the data point library is updated, the business major key counting is used to indicate the dataDivide the quantity of business major key corresponding to library.
Optionally, after the step of executing the corresponding operational order of the data access request on the data point library,The data access method further include:
The performance count in the data point library is updated, the performance count is used to indicate accessed time in the data point libraryNumber.
Optionally, the data access method further include:
Obtain the performance count in each data point library；
Do Data Migration processing in the data point library for being more than preset threshold to performance count.
Second aspect, the present invention provide a kind of data access device, comprising: receiving module carries business for receivingThe data access request of major key, the business major key is for identifying the data access request business datum pair to be accessedAs, the data access request includes: the inquiry request to the service data object, insertion request, removal request or moreNewly any one in request；
Determining module, for determining the corresponding data point library of the service data object according to the business major key；
Processing module, for executing the corresponding operational order of the data access request on the data point library.
Optionally, the determining module, comprising:
Enquiry module, for whether there is the business major key, business major key road in inquiry business major key routing tableIt is used to indicate by table: between the business major key of each service data object and the data point library of each service data object of storageCorresponding relationship；
First determination unit, if for there are the business major keys in the business major key routing table, by the businessLibrary is divided as the data in data point library corresponding with the business major key in major key routing table.
Optionally, the determining module, further includes:
Second determination unit, if for the business major key to be not present in the business major key routing table, using defaultAlgorithm determine the corresponding data point library of the business major key, and the business major key and the data are divided to the corresponding relationship in libraryIt is added in the business major key routing table.
Optionally, second determination unit, specifically for dividing lookup business major key minimum number in library from all dataData divide library；
Divide library for the data point library of the business major key minimum number as the corresponding data of the business major key.
Optionally, described device, further includes:
First update module counts, the business major key meter for updating business major key corresponding to the data point libraryNumber is used to indicate the quantity of business major key corresponding to the data point library.
Optionally, described device, further includes:
Second update module, for updating the performance count in the data point library, the performance count is used to indicate describedThe number that data divide library accessed.
Optionally, described device, further includes:
Module is obtained, for obtaining the performance count in each data point library；
Data Migration processing is done in transferring module, the data point library for being more than preset threshold to performance count.
The third aspect, the present invention provide a kind of computer readable storage medium, are stored thereon with computer program, the meterCalculation machine program realizes above-mentioned data access method when being executed by processor.
Fourth aspect, the present invention provide a kind of electronic equipment, comprising:
Processor；And
Memory, for storing the executable instruction of the processor；
Wherein, the processor is configured to realize above-mentioned data access method via the executable instruction is executed.
Data access method and device provided in this embodiment, after receiving data access request, from the data accessThe business major key for the service data object to be accessed is obtained in request, and then is determined according to the business major key and stored corresponding businessThe data of data object divide library, and then connect the database, divide on library in the data and execute the corresponding operation of data access requestInstruction, has dispersed database operating pressure, has improved database performance.
Detailed description of the invention
Fig. 1 is the flow chart of the embodiment one of data access method provided by the invention；
Fig. 2 is the flow chart of the embodiment two of data access method provided by the invention；
Fig. 3 is another flow chart of the embodiment two of data access method provided by the invention；
Fig. 4 is the flow chart of the embodiment three of data access method provided by the invention；
Fig. 5 is another flow chart of the embodiment three of data access method provided by the invention；
Fig. 6 is the structural schematic diagram of the embodiment one of data access device provided by the invention；
Fig. 7 is the structural schematic diagram of the embodiment two of data access device provided by the invention；
Fig. 8 is the system schematic of data access method provided by the invention；
Fig. 9 is the hardware structural diagram of server provided by the invention.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present inventionIn attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment isA part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the artEvery other embodiment obtained without creative efforts, shall fall within the protection scope of the present invention.
Current database technology is based on centralized database, that is, in whole system, only one database exists, instituteSome data are all stored in this database.User passes through this to the access process of all business objects stored in systemSingle database is completed.It is clear that the pressure of database can be very big under this mode, operating lag is easily caused, evenDelay machine and stop servicing.
The present invention provides a kind of data access method and device, and database is divided into multiple data point libraries, pre-establishes thisData divide the routing relation in library and business major key, when receiving the data access request of carrying business major key of user's input,It determines that data corresponding with the business major key divide library according to the business major key and above-mentioned routing relation, and then divides on library in the dataExecute the corresponding operational order of data access.Compared to the prior art, the operating pressure for having dispersed centralized database reduces hairA possibility that raw operating lag and delay machine.
How to be solved with technical solution of the specifically embodiment to technical solution of the present invention and the application below above-mentionedTechnical problem is described in detail.These specific embodiments can be combined with each other below, for the same or similar conceptOr process may repeat no more in certain embodiments.Below in conjunction with attached drawing, the embodiment of the present invention is described.
Fig. 1 is the flow chart of the embodiment one of data access method provided by the invention.As shown in Figure 1, the present embodiment mentionsThe data access method of confession, comprising:
S101, reception carry the data access request of business major key, and the business major key is visited for identifying the dataAsk the request service data object to be accessed, the data access request includes: to ask to the inquiry of the service data objectAny one asked, be inserted into request, removal request or update request；
Wherein, the business major key of service data object has uniqueness, i.e., different service data objects has different industryBusiness major key.It optionally, can be using the number of client or order number as business major key.
Wherein, data access request can be the inquiry request to service data object, can be for service data objectInsertion request, can be can also to be requested for the update to service data object to the removal request of service data object.
S102, according to the business major key, determine the corresponding data point library of the service data object；
Optionally, the mapping relations that can pre-establish business major key and data point library obtain current data access in S101After the business major key carried in request, data corresponding with the business major key can be obtained according to above-mentioned mapping relations and divide library, and willThe data point library is determined as storing the data point library for the service data object that the business major key is identified.
S103, the corresponding operational order of the data access request is executed on the data point library.
Wherein, when data access request is the inquiry request to service data object, S103 specifically: in the dataDivide on library and inquiry operation is executed to the service data object；When data access request is the insertion request to service data objectWhen, S103 specifically: divide on library in the data and insertion operation is executed to the service data object；When data access request isWhen to the removal request of service data object, S103 specifically: divide on library in the data and the service data object is executedDelete operation；When data access request is the update request to service data object, S103 specifically: divide library in the dataOn to the service data object execute update operation.
As an example it is assumed that data access request is the inquiry request to service data object A, the process of S101-S103For example: the inquiry request to service data object A for receiving user's input extracts business datum pair from the inquiry requestAs the business major key of A, it is assumed that be 201810001, according to the business major key and the mapping relations pre-established, determine with201810001 corresponding data divide library, that is, store the data point library of service data object A, it is assumed that divide library 1 for data, finallyDivide on library 1 inquiry operation executed to data object A in the data.
Since all business datums are respectively stored in different data point according to specific classifying rules by the present embodimentIn library, when user needs to access to specific service data object, directly according to the corresponding industry of the service data objectThe data that business major key inquiry stores the service data object divide library, and then divide on library in the data and execute corresponding operation instruction,The pressure for having dispersed centralized database in the prior art reduces and generates operating lag and a possibility that the problems such as delay machine.
In addition, in an embodiment of the present invention, after receiving data access request, judging in the data access requestWhether business major key is empty.If the business major key in the data access request is not sky, above method step S101- is executedS103；If the business major key in the data access request is sky, the data access request is distributed to all data pointLibrary divides library to execute associated data operation instruction, and after all data manipulations completion, merges all data by all dataDivide the result set in library.
Data access method provided in this embodiment, after receiving data access request, from the data access requestThe business major key for the service data object to be accessed is obtained, and then is determined according to the business major key and stores corresponding business datum pairThe data of elephant divide library, and then connect the database, divide on library in the data and execute the corresponding operational order of data access request, pointDatabase operating pressure has been dissipated, database performance is improved.
Fig. 2 is the flow chart of the embodiment two of data access method provided by the invention.As shown in Fig. 2, the present embodiment isFurther to the description of the achievable mode of S102 in above-described embodiment, as shown in Fig. 2, data access side provided in this embodimentMethod, comprising:
S201, reception carry the data access request of business major key, and the business major key is visited for identifying the dataAsk the request service data object to be accessed, the data access request includes: to ask to the inquiry of the service data objectAny one asked, be inserted into request, removal request or update request.
Wherein, the implementation of S201 is referring to S101 in above-described embodiment, and details are not described herein by the present invention.
It whether there is the business major key in S202, inquiry business major key routing table.
Wherein, the business major key routing table is used to indicate: the business major key of each service data object and storage are eachThe data of service data object divide the corresponding relationship between library.
If there are the business major keys in S203, the business major key routing table, will be in the business major key routing tableLibrary is divided as the data in data point library corresponding with the business major key.
For example, through inquiring, the corresponding data point library in above-mentioned routing table of business major key 201810001 is data pointLibrary 1 then shows that the corresponding service data object of business major key 201810001 is stored in data point library 1, subsequent in the data pointCorresponding operation is carried out to the service data object in library 1.
S204, the corresponding operational order of the data access request is executed on the data point library.
Wherein, the implementation of S204 can be found in S103 in above-described embodiment, and details are not described herein by the present invention.
It is shown in Figure 3, in order to record the accessed number in each data point library, method provided by the embodiment, further includes:
S205, the performance count that the data divide library is updated, it is interviewed that the performance count is used to indicate the data point libraryThe number asked.
Optionally, performance count area can be configured in the example information table that each data divide library, for characterizing corresponding numberThe number being accessed according to library.When some data point library is accessed by another, the performance count in the data point library can be added one, withMake that the performance count in the data point library always show is newest access total degree.
S206, the performance count that each data divide library is obtained；
Data Migration processing is done in S207, the data point library for being more than preset threshold to performance count.
Optionally, the accessed number in each data point library can be monitored in real time, when time that some data divides library accessedWhen number is more than preset threshold, the data stored in the data point library can be adjourned on reserved high-performance point library.
Data access method provided in this embodiment describes a kind of achievable mode in determining data point library, i.e., logicalPre-stored business major key routing table is crossed to inquire the corresponding data point library of the business major key.It is held on data point library to be subsequentThe step of row respective operations instruct provides foundation.
Fig. 4 is the flow chart of the embodiment three of data access method provided by the invention.The present embodiment is further to upperThe description of mode can be achieved in the another kind for stating S102 in embodiment, as shown in figure 4, data access method provided in this embodiment,Include:
S401, reception carry the data access request of business major key, and the business major key is visited for identifying the dataAsk the request service data object to be accessed, the data access request includes: to ask to the inquiry of the service data objectAny one asked, be inserted into request, removal request or update request.
It whether there is the business major key in S402, inquiry business major key routing table.
Wherein, the implementation of S401-S402 is similar with S201-S202 in above-described embodiment, and the present invention is no longer superfluous hereinIt states.
If the business major key is not present in S403, the business major key routing table, institute is determined using preset algorithmThe corresponding data point library of business major key is stated, and the corresponding relationship of the business major key and the data point library is added to the industryIn major key routing table of being engaged in.
In general, in the case where the data access request of user's input is insertion request, in business major key routing tableIt is that can not find the corresponding business major key of the service data object being inserted.At this moment, the insertion that can be inputted according to user is requestedThe business major key for the service data object of middle carrying being inserted, is calculated using preset algorithm and is inserted into for storing thisThe data of service data object divide library.
Optionally, the achievable mode in the corresponding data point library of the business major key is determined using preset algorithm are as follows: fromThe data for searching business major key minimum number in all data point libraries divide library；Divide the data of the business major key minimum number to libraryDivide library as the corresponding data of the business major key.
S404, the corresponding operational order of the data access request is executed on the data point library.
Wherein, the implementation of S404 can be found in S103 in above-described embodiment, and details are not described herein by the present invention.
It is shown in Figure 5, in order to get the currently stored service data object total quantity in each data point library,Data access method provided in this embodiment, after S403, further includes:
S403 ', the update data divide business major key corresponding to library to count, and the business major key counting is used to indicate instituteState the quantity of business major key corresponding to data point library.
Optionally, can in the example information table that each data divide library configuration service major key count area, for characterize pairThe quantity for the business major key for answering database to be stored.It, can when some data point library is inserted into a new service data objectDivide the business major key in library to count plus one the data so that the business major key in the data point library count always show be update afterQuantity.
Data access method provided in this embodiment describes the achievable mode of another kind in determining data point library, i.e.,When inquired in business major key routing table less than business major key entrained in current data access request, according to the business major keyCorresponding data point library is determined using preset algorithm, and the corresponding service data object of business major key is stored in the databaseIn, while the corresponding relationship of the business major key and data point library being added in business major key routing table, so that access next time shouldWhen service data object, library can be divided to corresponding data by business major key routing table lookup.On the other hand, by updating instituteIt states the business object that data point library stored to count, the business object in data point library can be made to count, and always show is business datumThe quantity of object be updated after quantity.
Fig. 6 is the structural schematic diagram of the embodiment one of data access device provided by the invention.As shown in fig. 6, this implementationThe data access device that example provides, comprising:
Receiving module 601, for receiving the data access request for carrying business major key, the business major key is for identifyingThe data access request service data object to be accessed, the data access request include: to the business datum pairThe inquiry request of elephant, any one being inserted into request, removal request or update request；
Determining module 602, for determining the corresponding data point library of the service data object according to the business major key；
Processing module 603, for executing the corresponding operational order of the data access request on the data point library.
Data access device provided in this embodiment can be used for executing the method in embodiment illustrated in fig. 1, realization principleSimilar with technical effect, details are not described herein.
Fig. 7 is the structural schematic diagram of the embodiment two of data access device provided by the invention.As shown in fig. 7, this implementationThe data access device that example provides, the determining module 602, comprising:
Enquiry module 701, for whether there is the business major key, the business major key in inquiry business major key routing tableRouting table is used to indicate: between the business major key of each service data object and the data point library of each service data object of storageCorresponding relationship；
First determination unit 702, if for there are the business major keys in the business major key routing table, by the industryLibrary is divided as the data in data point library corresponding with the business major key in business major key routing table.
Optionally, the determining module 602, further includes:
Second determination unit 703, if for the business major key to be not present in the business major key routing table, using pre-If algorithm determine the corresponding data point library of the business major key, and divide the corresponding of library to close the business major key and the dataSystem is added in the business major key routing table.
Optionally, second determination unit 703, which is specifically used for dividing in library from all data, searches business major key quantity mostFew data divide library；
Divide library for the data point library of the business major key minimum number as the corresponding data of the business major key.
The data access device that embodiment provides, further includes:
First update module 704 counts, the business major key for updating business major key corresponding to the data point libraryCount the quantity for being used to indicate business major key corresponding to the data point library.
Optionally, data access device provided in this embodiment, further includes:
Second update module 705, for updating the performance count in the data point library, the performance count is used to indicate instituteState the accessed number in data point library.
Optionally, data access device provided in this embodiment, further includes:
Module 706 is obtained, for obtaining the performance count in each data point library；
Data Migration processing is done in transferring module 707, the data point library for being more than preset threshold to performance count.
Data access device provided in this embodiment can be used for executing the method in Fig. 2-embodiment illustrated in fig. 5, realizePrinciple is similar with technical effect, and details are not described herein.
Fig. 8 is the system schematic of data access method provided by the invention.System shown in Figure 8 includes multiple composition portionsPoint, be respectively as follows: data access service module, primary database, management console, capacity and performance monitoring process, DDL go on patrol intoJourney, several points of libraries (Fig. 8 with point library 1, point library 2 ..., divide library N to illustrate).
Wherein, data access service module can be used for executing the method in any embodiment shown in Fig. 1-Fig. 5.Correspondingly,Data access device shown in Fig. 6 and Fig. 7 is the corresponding device of data access service module.
Wherein, as shown in figure 8, data access service module is connect with the application program to be serviced, which canTo be that any required backstage provides the application program of data support, such as insurance business systematic difference program；The application programIt can be carried in the equipment such as desktop computer, notebook, smart phone or tablet computer.User passes through the application triggers numberAccording to access request, data access service module can find corresponding data point library according to the business major key carried in the request, intoAnd corresponding operational order is completed on the data point library, disperse centralized database operating pressure, improves database performance.Specific implementation process can be described in detail in the following embodiments.
As shown in figure 8, primary database is connected with data access service module, it is required when for saving present invention operationConfiguration information.Such as: divide library definition, the routing of business major key and DDL old version record etc..It is defined about a point library, can use and divideThe formal definition of library example information table divides library, in point library example information table each point library record all have recorded one it is deployedData divide library, each point library record may include following necessary field:
1, ID: one, data point library data divide the unique identification in library.
2, access driver title: database access driver is the data base abstraction that can be instantiated a driving journeyThe subclass of sequence class, development language that database access driver title uses when implementing according to the present invention and have different performancesForm.Such as: in .NET platform, database access driver name is configured as " SYSTEM.DATA.SQLCLIENT ".
3, connection string: matching according to database access driver, is connected to the connection in the data point libraryCharacter string.
4, state: including in online, offline and migration.
5, version number: the version number of data structure in the data point library is recorded.
6, business datum major key counts: the data volume of the service data object saved in data point library.
7, performance count: the number for dividing library accessed for characterize data.
8, capacity: data divide the data capacity in library.
9, remaining space: data divide the database remaining space in library.
It is routed about business major key, routing relation, the routing of business major key can be saved with the form of business major key routing tableTable is the corresponding table of business major key with data point library ID.May include following field:
1, business major key: the primary identity of a service data object.
2, the ID in data point library: being used to indicate different business data object and be specifically stored in which data point library, associationIn the ID divided in the example information table of library.
3, Obj State: in normal and migration.
4, last access time.
5, number of operations counts.
It is recorded about DDL old version, which records for recording in this system and data structure definitionRelated operational order history.It is executed by the sequence of these operational orders, the data structure in data point library can be synchronized to mostNew state.DDL old version record sheet may include following field:
1, DDL version number: the integer of sequence can all be registered as a new version when executing DDL sentence every time.
2, DDL command context: big content of text records the order of the secondary DDL.
Management console in Fig. 8 is for completing the definition of data point library, the status inquiry of data point library and DDL order publicationFunction.The DDL order that one will execute total data point library can be enrolled into DDL history version by the issuing function of DDL orderIn this record sheet, used for DDL patrol program.
DDL patrol program in Fig. 8 is the program that a timing executes.Its function is to check that each data point library recordsIn, whether version number is less than current registered maximum DDL version.As some data divides the version number in library maximum less than currentVersion number, then executing the DDL order having not carried out, sequentially on the data point library the data are divided the database knot in libraryStructure is updated to last state.
Capacity and performance monitoring process in Fig. 8 are the programs being periodically executed.Its function is that tours of inspection is allData divide the performance and easy parameter in library, and update dividing in the example information table of library into primary database.In some business major keysDivide in the strategy of library, these performance capability data will be used to balance the performance pressures of each database.As a function of the inventionCan extension, monitoring process can be when Dynamic Discovery database access amount be excessive or the access temperature mistake of certain business major keyGao Shi, the transition process of automatic starting overheat data object, for example data are adjourned on reserved high-performance point library etc..
Fig. 9 is the hardware structural diagram of electronic equipment provided by the invention.As shown in figure 9, the electronics of the present embodiment is setIt is standby to may include:
Memory 901, for storing program instruction.
The processor 902, for being performed the data for realizing any of the above-described embodiment description in described program instructionAccess method, specific implementation principle can be found in above-described embodiment, and details are not described herein again for the present embodiment.
The present invention provides a kind of computer readable storage medium, is stored thereon with computer program, the computer programData access method described in any of the above-described embodiment is realized when being executed by processor.
The present invention also provides a kind of program product, described program product includes computer program, and the computer program is depositedIn readable storage medium storing program for executing, at least one processor can read the computer program, institute from the readable storage medium storing program for executing for storageState at least one processor execute the computer program make electronic equipment implement data described in any of the above-described embodiment visitAsk method.
In several embodiments provided by the present invention, it should be understood that disclosed device and method can pass through itIts mode is realized.For example, the apparatus embodiments described above are merely exemplary, for example, the division of the unit, onlyOnly a kind of logical function partition, there may be another division manner in actual implementation, such as multiple units or components can be tiedAnother system is closed or is desirably integrated into, or some features can be ignored or not executed.Another point, it is shown or discussedMutual coupling, direct-coupling or communication connection can be through some interfaces, the INDIRECT COUPLING or logical of device or unitLetter connection can be electrical property, mechanical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unitThe component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multipleIn network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme's.
It, can also be in addition, the functional units in various embodiments of the present invention may be integrated into one processing unitIt is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated listMember both can take the form of hardware realization, can also realize in the form of hardware adds SFU software functional unit.
Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention., rather than its limitations；To the greatest extentPipe present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that: its according toSo be possible to modify the technical solutions described in the foregoing embodiments, or to some or all of the technical features intoRow equivalent replacement；And these are modified or replaceed, various embodiments of the present invention technology that it does not separate the essence of the corresponding technical solutionThe range of scheme.