CN101587639B - City bus information management and dispatch decision support system based on network - Google Patents
City bus information management and dispatch decision support system based on networkDownload PDFInfo
- Publication number
- CN101587639B CN101587639BCN2009100627939ACN200910062793ACN101587639BCN 101587639 BCN101587639 BCN 101587639BCN 2009100627939 ACN2009100627939 ACN 2009100627939ACN 200910062793 ACN200910062793 ACN 200910062793ACN 101587639 BCN101587639 BCN 101587639B
- Authority
- CN
- China
- Prior art keywords
- resource
- service
- node
- information
- grid
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034methodMethods0.000claimsabstractdescription41
- 238000004364calculation methodMethods0.000claimsabstractdescription32
- 230000008569processEffects0.000claimsabstractdescription30
- 238000004891communicationMethods0.000claimsabstractdescription15
- 238000007726management methodMethods0.000claimsdescription36
- 230000005540biological transmissionEffects0.000claimsdescription32
- 238000012546transferMethods0.000claimsdescription23
- 238000012544monitoring processMethods0.000claimsdescription20
- 238000009826distributionMethods0.000claimsdescription8
- 230000008878couplingEffects0.000claimsdescription7
- 238000010168coupling processMethods0.000claimsdescription7
- 238000005859coupling reactionMethods0.000claimsdescription7
- 238000005538encapsulationMethods0.000claimsdescription7
- 230000008520organizationEffects0.000claimsdescription7
- 230000000694effectsEffects0.000claimsdescription5
- 238000013507mappingMethods0.000claimsdescription5
- 230000003068static effectEffects0.000claimsdescription5
- 238000013396workstreamMethods0.000claimsdescription5
- 230000007246mechanismEffects0.000claimsdescription4
- 230000000737periodic effectEffects0.000claimsdescription4
- 238000009434installationMethods0.000claimsdescription3
- 238000006243chemical reactionMethods0.000claimsdescription2
- 238000000354decomposition reactionMethods0.000claimsdescription2
- 238000011156evaluationMethods0.000claimsdescription2
- 230000008676importEffects0.000claimsdescription2
- 239000000344soapSubstances0.000claims1
- 230000006870functionEffects0.000description10
- 238000011161developmentMethods0.000description9
- 230000018109developmental processEffects0.000description9
- 238000005516engineering processMethods0.000description9
- 230000008859changeEffects0.000description3
- 238000013461designMethods0.000description3
- 230000003993interactionEffects0.000description3
- 238000004422calculation algorithmMethods0.000description2
- 238000013500data storageMethods0.000description2
- 238000012545processingMethods0.000description2
- 238000004458analytical methodMethods0.000description1
- 238000000151depositionMethods0.000description1
- 238000001514detection methodMethods0.000description1
- 238000002474experimental methodMethods0.000description1
- 230000009969flowable effectEffects0.000description1
- 238000009440infrastructure constructionMethods0.000description1
- 230000010354integrationEffects0.000description1
- 239000000463materialSubstances0.000description1
- 230000013011matingEffects0.000description1
- 238000012797qualificationMethods0.000description1
- 230000008521reorganizationEffects0.000description1
- 238000011160researchMethods0.000description1
- 238000004088simulationMethods0.000description1
- 230000033772system developmentEffects0.000description1
- 238000012795verificationMethods0.000description1
Images
Landscapes
- Multi Processors (AREA)
Abstract
Description
Technical field
The invention belongs to intelligent bus and decision support field, be specifically related to a kind of city bus information management and scheduling decision back-up system based on grid.
Background technology
Along with fast development of national economy, the mobile total amount of personnel, goods and materials constantly increases, and the contradiction between continuous momentum of development in city and the city space resource availability makes the development of urban public tranlport system more and more have great importance.Owing to lack advanced technological means, the collection of transport information and management lag behind the needs of development all the time, have brought very big influence for smooth and easy and people's car trip safety of urban transportation, are restricting the development of urban economy comprehensively.
Public transport is first developed in the city, and the infrastructure construction of accelerating urban public tranlport system is an inevitable choice of walking sustainable development path.At first, the general level of IT application of public transit system in the most of city of China is not high, and management operating is to adopt method dependence experience manually to carry out for a long time, and therefore exploitation informationization, intelligentized urban public tranlport system are the inevitable requirements of development; Secondly, mutual difficulty between each subsystem in order to obtain real-time passenger flow information dynamically, guarantees that vehicle moves on schedule in the prevailing system, and making traveler can pass through vehicle-mounted information service system Real-Time Sharing traffic trip information, we must provide an information interaction to share system more easily; Moreover, traditional intelligent transportation system adopts centralized processing, the operation cost height, and lack emergency processing ability to emergency episode, therefore for better storage computation mass traffic information, we need design one and be more suitable for the system that handles distributed resource, have the Real-time Traffic Information disposal ability.
High speed development along with calculating, communication, memory technology, modern computer network technologies can realize highly difficult operations such as extensive supercomputing, mass data storage, and grid (Grid) the technology current research focus in this field especially, its appearance can perfectly solve the contradiction of traditional public transportation system and the development of real traffic.Grid will the resources such as all kinds of computers, database and memory device of dispersed and distributed couple together on the region by network, form towards wide scope, to the high-performance calculation and the service environment of user transparent.Grid has been realized comprehensive connection of all resources on the Internet, and whole the Internet is integrated into a huge virtual supercomputer, realizes the overall sharing of computational resource, storage resources, the communication resource, software resource, information resources and knowledge resource.
Summary of the invention
The object of the present invention is to provide a kind of city bus information management and scheduling decision back-up system based on grid, this system has Sharing degree height, collaborative work is strong, the system expandability is strong characteristics.
City bus information management and scheduling decision back-up system based on grid provided by the invention is characterized in that: this system comprises master server and is positioned at autonomous territory two parts of distributed grid computing system;
Master server comprises grid portal, workflow engine and authentication center;
Grid portal is responsible for providing the inlet of user capture grid environment;
Workflow engine is responsible for finishing the workflow instance flow process from abstract grid work flow model to concrete grid work flow, obtains the concrete subjob carried out information, at last subjob is distributed to corresponding territory job manager and is carried out actual operation execution;
Authentication center is responsible for verifying and authorize corresponding System Privileges to the subscriber identity information that is received by grid portal;
Comprise domain information service module, territory job manager, domain manager and resource node cluster respectively in the autonomous territory;
The resource node cluster is finished the structure of gridding resource and storage, encapsulation, registration, management, monitoring and the execution of decision-making resource, is the place of realizing the communications policy service;
The information of Grid Metadata in the autonomous territory is in charge of and is safeguarded to the domain information service module, realizes the resource view in autonomous territory; The domain information service module provides the gridding information service by grid portal to the user, and real-time update gridding resource information; Each domain information service module is collected the node information on services of the resource node cluster report in this autonomous territory, and is periodic simultaneously by the resource information in each autonomous territory of the mutual communications exchange of point-to-point mode, to set up the resource mapping of the overall situation;
The territory job manager is responsible for the job request information that collection work stream engine provides, and request responds timely to user job to use the decision-making resource, calls the request execution that fulfils assignment of the resource node in the corresponding resource node cluster in autonomous the territory in; Simultaneously, in the process that operation is carried out, the territory job manager receives the real-time monitor message of service of resource node cluster, makes gridding resource and decision-making resource obtain reasonably to distribute to use by scheduling of resource, improves the balancing dynamic load in the whole autonomous territory;
Domain manager is in charge of the resource of Virtual Organization in the autonomous territory, understand the statistical information of resource in the Virtual Organization and the statistical information of single tissue, the unified interface of inquiry, access resources is provided for the user, coordinate the shared use of resource, and carry out the mutual of resource information with the resource node cluster of lower floor.
System of the present invention utilizes grid, geography information (GIS) technology, GPRS multiple technologies means such as (GPRS), solves a multinomial key technology difficult problem related in the intelligent public transport information system.With regard to the design of public transport information system, the present invention adopts grid to come standard to make up the traffic decision-making back-up system, various decision-making resources are packaged into mesh services, be distributed on each relatively independent grid computing node, carry out the cooperative scheduling of multinode, be based on the solution that present domestic bus dispatching system development survey and analysis of status is drawn.Its characteristics are:
(1) Sharing degree height
The present invention utilizes the powerful data storage technology of grid, well solved the seamless storage problem of mass GPS, GIS database, for the calculating storage of the needed large-scale dataset of decision support is laid a good foundation.From the information sharing angle, the present invention is that the form in autonomous territory manages with resource division.The bus dispatching subsystem of each bus subsidiary is as the autonomous territory of a grid, preliminary preliminary treatment is done to its own a large amount of original transport information separately in each autonomous territory, and as required data processed is packaged into various mesh services, this structure has effectively been broken information isomerism bottleneck, provides high-level more fast and effectively decision information to the policymaker.From system integration angle, the present invention has broken each self-enclosed state of traditional bus dispatching subsystem, by implementing the resource-sharing between unified standard realization heterogeneous system, (being the autonomous territory of grid) closely combined by the service call of loose coupling, realized the conception of intelligent bus information platform.
(2) collaborative work is strong
The present invention is real-time, the dynamic traffic system of trans-sectoral affair, can be dynamically and visit the service of distributed miscellaneous service function smoothly, and utilize the grid work flowable state to be integrated into new operation flow as required, and needn't be concerned about affiliated function, geographical position, internal structure, the execution details of concrete Executive Module, improved the collaborative work ability of system greatly.
(3) system expandability is strong
Because each functional module all adopts the form of mesh services to develop in the invention, and adopt the grid work flow model to make up, increased the loose coupling degree of system greatly.The user can finish required difference in functionality by the reorganization configuration to basic module, and initiate functional module can be called easily by the encapsulation of mesh services form, has avoided problem in traditional closed intelligent transportation system, the problem includes: the repeated encoding problem.
Description of drawings
Fig. 1 is the structural representation of system of the present invention;
Fig. 2 is a resource node structural representation of the present invention;
Fig. 3 is service instantiation process figure of the present invention;
Fig. 4 creates for GridFTP transfer of data of the present invention connects and transmission constructive process figure;
Fig. 5 is the autonomous territory of the present invention job scheduling flow chart.
Embodiment
The present invention solves two key issues emphatically: the one, how in existing grid environment, dispose the traffic application service, i.e. the service network deployment of formatting; The 2nd, how the service of having disposed is registered, searches for, creates, carried out to support public transport decision-making, i.e. grid service instantiation process.
Service network of the present invention is formatted to dispose and is related to five parts: resource, operation, information service, the management of autonomous territory and man-machine interaction.Wherein, resource is meant computational resource, storage resources, public transport simulation software and the public transport Legacy System resource that need use, public transport isomeric data resource etc. in grid; Operation refer to mesh services in grid environment from instantiation, service assignment, carry out the process that obtains result of calculation; Resource registering and the search procedure in the grid environment finished in information service; The management of autonomous territory is finished in the autonomous territory of resource in the grid environment between management and autonomous territory alternately; Man-machine interaction then be in service registry, selection, implementation in order to realize the user that specific user's job requirements is taked and the reciprocation of grid environment, realize by user's space and grid portal 1.1.
Below by by embodiment the present invention being described in further detail, but following examples only are illustrative, and protection scope of the present invention is not subjected to the restriction of these embodiment.
As shown in Figure 1, system of the present invention comprisemaster server 1 and be positioned at the distributed grid computing system autonomous territory 2.1,2.2 ..., 2.n two parts, n is a positive integer, represents the number in autonomous territory.
Grid portal 1.1 is responsible for providing the inlet of user capture grid environment, comprises user's space, application program entry and user instruction three parts that enter the mouth.Wherein, the concrete Authorized operation (comprise that the user logins, user profile inquiry, user operation records etc.) of user in the grid environment is in charge of and is monitored to user's space, so that each different user can obtain personalized customize services according to self-demand; Application program entry offers submission of user from writing the operation-interface of application program, the user uses this interface will be certainly writing application deployment behind grid, can directly utilize the computational resource of grid and the Distributed Calculation that storage resources carries out this program, this function mainly is the checking at a large amount of simulation algorithms in the traffic science experiment; The user instruction inlet has then provided the interface of an existing communications policy mesh services of user capture system, the relevant grid decision service of a series of field of traffic that the user has developed by input service call instruction (as service name, data source address etc.) calling system is finished self needed decision support function.
Workflow engine 1.2 is mainly used in the instantiation flow process of finishing abstract grid work flow model and the execution of managing concrete grid work flow.It receives the abstract grid work flow model that the user provides from grid portal 1.1, (wherein abstract grid work flow model belongs to Problem Areas to the workflow instance flow process of concrete grid work flow to finish abstract grid work flow model, concrete grid work flow belongs to solution space, workflow instanceization is promptly set up the process of mapping to abstract grid work flow model and concrete grid work flow by the matching process in territory under striding, finish the mapping of separating of problem), obtain the concrete subjob carried out information and (comprise autonomous territory, operation procedure place, the operation physical address, the sequence of operation etc.), at last subjob is distributed to corresponding territory job manager and carried out actual operation execution.
When the user provide be not direct abstract grid work flow model the time, workflow engine 1.2 can also help the user to set up abstract grid work flow model.At this moment, it receives the decision task information that the user provides from grid portal 1.1, provides the graphics edition interface to help the user to set up abstract grid work flow model.
Authentication center 1.3 is responsible for verifying and authorize corresponding System Privileges to user's identity.It receives the certificate of certification information that the user provides from grid portal 1.1, confirms whether authentication is successful, determines then that as success the user logins qualification and preserves certificate, as the then return authentication failure information of failing.
Autonomous territory 2.1,2.2 ..., comprise respectively among the 2.n domain information service module 3.1,3.2 ..., 3.n, territory job manager 4.1,4.2 ..., 4.n, domain manager 5.1,5.2 ..., 5.n, and resource node cluster 6.1,6.2 ..., 6.n.
Resource node cluster 6.1,6.2 ..., comprise a plurality of resource node a of identical or different number in the 6.n, resource node a can be divided into computational resource node and storage resources node two classes, wherein the computational resource node refers to the resource node that calculates needed hardware system (as CPU, internal memory etc.) and software platform can be provided, and the storage resources node refers to provide the resource node of needed hardware system of storage (as memory, buffer memory) and software platform (as Various types of data base management system, file management system).The structure of all kinds of resource node a is provided with node service container b and some gridding resource h and decision-making resource j all as shown in Figure 2 in it.Be provided with nodal information service module c, node resource service module d, node resource management services module e, grid file host-host protocol (GridFTP) transmission service module f and monitoring resource service module g in the node service container b.
Node service container b is responsible for providing on each node in grid environment that a mesh services is installed, disposed, the environment of operation, monitoring, and provides support for the resource real-time status that monitors grid node.Any node resource service module d must be configured among the node service container b could be searched with call.
The function of nodal information service module c is similar to the domain information service module, and it safeguards local node resource or service metadata information, on the node of resource registering in the autonomous territory, makes that the resource of node or information on services are discerned by grid.For the service that is deployed in the node service container b, nodal information service module c collects its information automatically; Then import resource information by hand for the resource that is not deployed in the node service container b by resource provider.Nodal information service module c will periodically register or collect the information of local node to the report of domain information service module simultaneously.
Node resource service module d is responsible for making resource to call for the territory job manager with the service form of loose coupling to gridding resource h and the encapsulation of decision-making resource j service.Node resource service module d comprises computing node resource service module and memory node resource service module.Wherein computing node resource service module mainly is responsible for providing the calculation task in the grid service instantiation process to calculate required computing environment, and memory node resource service module mainly is responsible for providing the memory space in the calculation task desired data source in the grid service instantiation process.
The function of node resource management services module e is similar to domain manager, is in charge of and coordinates all kinds of gridding resources and decision-making resource of this intranodal, and the real-time resource control information of acceptance domain manager is to assist to finish the resource management requirement of the grid overall situation simultaneously.
Transmission service module (f) adopts GridFTP (grid file host-host protocol), it is responsible in the process of fulfiling assignment needed data transport service between storage resources node and computational resource node, comprises two parts of transmission client module and index server module.The transmission client module mainly is responsible for the foundation of transfer of data between storage resources node and computational resource node, third party's transmission, the re-transmission that makes mistakes in service instantiation process, is destroyed and create or the like; The index server module is responsible for providing the positional information at data place, comprise nodal information catalogue module and two parts of node file index module, wherein, the nodal information catalogue module is responsible for the simple files function management of storage resources node, and node file index module is responsible for the statistic record of storage resources nodal information state, as sink information of the releasing news of the statistic record of file access information, file, file etc.;
The static properties and the dynamic performance parameter of resource monitored on monitoring resource service module g was responsible for when the traffic grid work each cluster, to understand the load and the ruuning situation of whole mesh network network, in order to the usefulness of scheduling.These dynamic and static information of the periodic real-time update of monitoring resource service module g are carried out the reference information of autonomous territory internal burden balance as the territory job manager.Simultaneously, the resource performance that monitoring resource service module g collects same application example utilizes situation, ruuning situation, storage resources and instrument resource ground operating position etc. as computational resource, so that operating single grid application example is carried out Performance Evaluation, resource requirement and consumption situation in the reflection example running are with the dynamic assignment and the scheduling of guiding work stream engine 1.2.
Gridding resource h and decision-making resource j provide the real resource of communications policy support service.Wherein, the grid equipment that gridding resource h refers to and field of traffic is irrelevant, first-class as computational resource, storage resources, network access device, transducer, shooting; The decision-making resource then refers to and the closely-related resource of communications policy, as forecasting traffic flow model, traffic information database, traffic simulation instrument etc.
Domain information service module 3.1,3.2 ..., 3.n is the important component part in the network of communication lines case system bottom architecture, be in charge of and safeguard the information of (comprising various resources and service metadata in the grid environment) of Grid Metadata in the autonomous territory, realize the resource view in autonomous territory, provide the gridding information service by grid portal 1.1 to the user, and real-time update gridding resource information.Each domain information service module is collected the node information on services of the nodal information service module c report in this autonomous territory, and is periodic simultaneously by the resource information in each autonomous territory of the mutual communications exchange of point-to-point mode, to set up the resource mapping of the overall situation.
Territory job manager 4.1,4.2 ..., 4.n is responsible for the job request information that collection work stream engine 1.2 provides, request responds timely to user job to use resource, calls the node corresponding resource service module d request execution that fulfils assignment in autonomous the territory in; Simultaneously, in the process that operation is carried out, the territory job manager receives the real-time monitor message of service of monitoring resource service module g, makes gridding resource and decision-making resource obtain reasonably to distribute to use by scheduling of resource, improves the balancing dynamic load in the whole autonomous territory.In the present invention, the territory job manager adopts the scheduling mechanism based on PBS, constitute by 3 modules, and be respectively client server, job scheduler and node actuator.Wherein client server is the core of entire domain job manager, is responsible for receiving various external request, realizes monitoring, distribution and management to resource; Job scheduler is responsible for carrying out the scheduling of task; The node actuator mainly is the detection of carrying out resource, and feeds back to client server.
Domain manager 5.1,5.2 ..., 5.n is in charge of the resource of Virtual Organization in the autonomous territory, understand the statistical information of resource in the Virtual Organization and the statistical information of single tissue, the unified simple interface of inquiry, access resources is provided for the user, coordinate the shared use of resource, and carry out the mutual of resource information with the node resource management services module e of lower floor.
Format after deployment finishes in service network, the present invention is based on the city bus information management of grid and scheduling decision back-up system and just can call the traffic application service and use to support communications policy.Its typical grid service instantiation process is as shown in Figure 3:
(1) subscriber authentication
(1.1) grid portal 1.1 is accepted the user certificate that the user provides, certificate information comprises Customs Assigned Number, name, login password, affiliated tissue etc., adopt X.509 the certificate of certification format standard to write, and transfer to authentication center 1.3 and be responsible for user's identity is verified;
(1.2) in this example, authentication center 1.3 mainly comprises Light Directory Access Protocol (LDAP) and the online certificate server of MyProxy.At first, authentication center 1.3 passes to ldap directory with the user certificate that receives, the passing user authentication information that writes down in this user certificate information and the ldap directory is compared, if compare successfully, just send the assertion message that an authentication is passed through to the user, if comparison is failed, then send the assertion message of an authentification failure to the user.Then, customer attribute information in the ldap directory query directory, certificate and attribute of user according to the user submits to send an attribute assertion message to the user, determine the authority of user capture system.Simultaneously, user oneself preserves and the process of management private cipher key and certificate file in order to simplify, and authentication center 1.3 uses the online certificate server of MyProxy, preserves and the leading subscriber certificate, for the user fetches, upgrades and create interim short-lived certificates;
(2) information on services coupling
(2.1) service request of domain information service module reception login user submission (wherein, service request information comprises: service name, service-number, address of service, serve port, service data source position etc., and encode) with the form of XML, according to service request information the information on services in the autonomous territory is searched for coupling, (present matching algorithm is mainly considered to mate by identical service name or service-number), and return the WSDL mesh services description document that satisfies the traffic mesh services in the autonomous territory of asking;
(2.2) the domain information service module is collected service status information among the domain node information service module c by the subscribing mode, with services selection, the distribution of support region job manager; Simultaneously, the domain information service module carries out data sync with the form of point-to-point (P2P) to the domain information service module in the adjacent autonomous territory and duplicates;
(3) workflow modeling
(3.1) workflow engine 1.2 provides a patterned editing interface assisted user to determine in the operation flow procedure relation (mating according to service function in service logic of using and the WSDL mesh services description document information that searched) between each service, carry out personalized abstract grid work flow model modeling, finish the foundation of one-to-one relationship between the service that searched and the activity in the workflow, and represent its concrete grid work flow with the form of BPEL (BPEL).
(3.2) workflow engine 1.2 obtains the concrete subjob carried out information (comprising autonomous territory, operation procedure place, operation physical address, the sequence of operation etc.) according to the corresponding relation of service and subtask among the BPEL, it is defined as the grid work that job description language (JDL) is described, and dynamically disposes the territory job manager.
(4) service assignment of operation
What the territory job manager was accepted workflow engine 1.2 transmissions is the grid work request JDL task description file of host-host protocol with Simple Object Access Protocol (SOAP), fulfils assignment to the distribution of service according to operation address, job title, operation and service binding information among the JDL.
(5) instantiation of service is disposed
(5.1) if define in the JDL task description file be the user submit to write application program certainly, the territory job manager is at first downloaded this program in user's space so, the resource packet holding tool that adopts Axis to provide carries out application service encapsulation (will be encapsulated into the Web service form with the application program of writing certainly of executable file EXE form compiling) to program, and according to the description of the WSDL in this Web service registration, installation, after service instantiation, again object code is signed, prevent to distort;
(5.2) if what define in the JDL task description file is the field of traffic service that system has developed, the territory job manager is directly located the position of this service and is carried out instantiation operation so.
(5.3) then, the territory job manager sends data transfer request to suitable data node resource service module d according to the demand information of data source in the job description; Simultaneously, performed service decomposition is become several calculation tasks parallel or serial, according to the service requirement and the specifying information of idling-resource (wherein service request information comprises the minimum cpu frequency of service, minimum CPU usage, the minimized storage space that service data source takies, intermediate data minimized storage space etc., idling-resource information comprises the cpu type of resource, the total frequency of the CPU of resource, the current utilance of the CPU of resource, the current storage size of utilizing of resource, the current memory size etc. that utilizes of resource), the computing node resource service module d that a selection part satisfies the minimum requirement of service participates in calculating, and calculation task is dispatched to the computing node resource service module d wait transfer of data that participates in calculating;
(6) visit of service data source
The autonomous territory of storage resources interior nodes has been disposed node service container b, the data transfer request that the acceptance region job manager sends, create back end resource service module d, data and file in the message reference memory nodes such as the Data Position that comprises according to request, transfer of data terminal point, and be transferred to the corresponding computing node of territory job manager appointment.Wherein data access is realized by the data access interface (OGSA-DAI) of Open Grid Services Architecture, comprises three class activities such as inquiry, expression conversion and transmission;
(7) transmission of service data source
Transmission service module f realizes the transfer of data between data source memory node resource service module d and computing node resource service module d, attribute according to definite transmission such as the actual loading of user's transmission demand information (as transmission minimum-rate, serious forgiveness etc.) and storage resources, network condition, replica management mechanism is set, and transfers data to the Practical Calculation node resource service module d of territory job manager distribution;
(8) Fu Wu execution and monitoring
(8.1) the appointment computing node service container b in the grid downloads code execution environments and registration is installed from the territory job manager, becomes the computing node resource service module d in the grid, and the transmission of waiting for desired data is to carry out calculation task;
(8.2) the mobile deployment agency of territory job manager establishment, be used to monitor distribution, execution and the last termination of the calculation task that belongs to same calculation procedure, it can be transferred to the client designated destination and carry out, also can change the position at any time, so that data are being provided to calculation task or when calculation task obtains data, are reducing data traffic the network as far as possible;
(8.3) each computational resource node resource service module d carries out calculation task according to the calculation procedure of disposing after obtaining calculated data, acts on behalf of condition report feedback and transfers to the territory job manager for user monitoring and management to moving to dispose at any time;
(9) service result storage
The territory job manager compiles result of calculation and transfers in the system database by transmission service module f, and the system service presentation layer adopts the C#.NET technology to write, and uses the stored data base of SQL Server database as final result.Collecting the result of calculation stage, move to dispose to act on behalf of and to duplicate or transfer to the SQL SERVER place main frame of depositing result data, control the result data stream that each resource provider sends effectively, and before the storage final result, again these data are handled.
(10) service result is showed
(ActiveX Data Objects ADO.NET) obtains the result of calculation that is stored in the SQL SERVER database, and the form by User represents to the user by the .NET data access interface for grid portal 1.1.
(11) autonomous territory management
In whole service instantiation process, domain manager all is responsible for memory node resource in the autonomous territory and computing node resource are managed, carry out the mutual of resource information with the node resource management services module e of lower floor, the withdrawing from and add of node resource in the management system is called SRM and managing computing resources.
In grid service instantiation process step (7), the present invention relates to the transfer of data of the transmission service module f of grid, its GridFTP transfer of data connects establishment and transmits constructive process as described in Figure 4:
(1) user at first logins transmission client by authentication, and transmission client reads user profile and sets up user data space;
(2) user submits data file transmission request in exclusive user data space, transmission client is by file logical name query node file index, find out the nodal directory that comprises this logical file, then shining upon the physical address of this logical file in the storage resources node by the nodal information catalogue returns to the user;
(3) user setup data transmission parameters, comprise the application for registration spatial cache, specify call back function, set cache size, set transmission mode, wire data type is set, be provided with server static/activity etc., set up the internodal transfer of data of transmission client and storage resources to reach an agreement on;
(4) data transport service of GridFTP startup self transmits data to destination node from source node.
It should be noted that safe mode with traditional normative document host-host protocol (FTP) different be the security mechanism that the GridFTP agreement comprises grid security architecture (GSI), therefore when connecting, need finish by the checking of legal certificate.Here we adopt function and interface that the commercial grid kit of Java (Java Commodity Grid Toolkit) is provided, generate and obtain letter of attorment, again it is packaged into and is stored the form that resource node is accepted, submit to the storage resources node verification.
In the step in grid service instantiation process (8), the present invention relates to the autonomous territory job scheduling of system.Autonomous territory job scheduling flow process in its job manager is as shown in Figure 5:
(1) in autonomous domain scheduling, job manager is submitted to operation in the job queue of local job scheduler, simultaneously the request of sending running job to client server;
(2) client server and job scheduler carry out periodical communication, after client server receives job request, and can be according to the demand notice job scheduler resource needed number and the resource type of operation;
(3) job scheduler and node actuator communicate, and survey each state of resources;
(4) job scheduler notice client server available resources are distributed desired resource by scheduling to operation simultaneously;
(5) client server with operation send to each general operation service (General RunningService, GRS) in, the execution of general operation service startup and monitoring task, and execution result returned to client server.
(6) general operation service is by the execution operation required data of data, services visit by the GridFTP transmission.
The present invention not only is confined to above-mentioned embodiment; persons skilled in the art are according to content disclosed by the invention; can adopt other multiple embodiment to implement the present invention; therefore; every employing project organization of the present invention and thinking; do some simple designs that change or change, all fall into the scope of protection of the invention.
Claims (2)
1. city bus information management and scheduling decision back-up system based on a grid, it is characterized in that: this system comprise master server (1) and be positioned at the autonomous territory of distributed grid computing system (2.1,2.2 ..., 2.n) two parts, n is a positive integer, represents the number in autonomous territory;
Master server (1) comprises grid portal (1.1), workflow engine (1.2) and authentication center (1.3);
Grid portal (1.1) is responsible for providing the inlet of user capture grid environment;
Workflow engine (1.2) is responsible for finishing the workflow instance flow process from abstract grid work flow model to concrete grid work flow, obtain the concrete subjob carried out information, at last subjob is distributed to corresponding territory job manager and carried out actual operation execution;
Authentication center (1.3) is responsible for verifying and authorize corresponding System Privileges to the subscriber identity information that is received by grid portal (1.1);
Autonomous territory (2.1,2.2 ..., 2.n) in comprise respectively the domain information service module (3.1,3.2 ..., 3.n), the territory job manager (4.1,4.2 ..., 4.n), domain manager (5.1,5.2 ..., 5.n) and the resource node cluster (6.1,6.2 ..., 6.n);
The resource node cluster (6.1,6.2 ..., 6.n) finish the structure of gridding resource and storage, encapsulation, registration, management, monitoring and the execution of decision-making resource, be the place of realizing the communications policy service;
The domain information service module (3.1,3.2 ..., 3.n) be in charge of and safeguard and the information of Grid Metadata in the autonomous territory realize the resource view in autonomous territory; The domain information service module (3.1,3.2 ..., 3.n) provide the gridding information service by grid portal (1.1) to the user, and real-time update gridding resource information; Each domain information service module is collected the node information on services of the resource node cluster report in this autonomous territory, and is periodic simultaneously by the resource information in each autonomous territory of the mutual communications exchange of point-to-point mode, to set up the resource mapping of the overall situation;
The territory job manager (4.1,4.2 ..., 4.n) be responsible for the job request information that collection work stream engine (1.2) provides, request responds timely to user job to use the decision-making resource, calls the request execution that fulfils assignment of the resource node in the corresponding resource node cluster in autonomous the territory in; Simultaneously, in the process that operation is carried out, the territory job manager receives the real-time monitor message of service of resource node cluster, makes gridding resource and decision-making resource obtain reasonably to distribute to use by scheduling of resource, improves the balancing dynamic load in the whole autonomous territory;
Domain manager (5.1,5.2 ..., 5.n) be in charge of the resource of Virtual Organization in the autonomous territory, understand the statistical information of resource in the Virtual Organization and the statistical information of single tissue, the unified interface of inquiry, access resources is provided for the user, coordinate the shared use of resource, and carry out the mutual of resource information with the resource node cluster of lower floor;
Comprise a plurality of resource nodes (a) of identical or different number in each resource node cluster, resource node (a) is divided into computational resource node and storage resources node; Be provided with node service container (b) and some gridding resources (h) and decision-making resource (j) in each resource node (a); Gridding resource (h) is meant general grid equipment, and decision-making resource (i) is meant the resource relevant with communications policy;
Be provided with nodal information service module (c), node resource service module (d), node resource management services module (e), transmission service module (f) and monitoring resource service module (g) in the node service container (b);
Node service container (b) is responsible for providing on each resource node in grid environment the environment of installation, deployment, operation and the monitoring of node resource service module, and provides support for the resource real-time status of monitoring resources node;
Nodal information service module (c) is used to safeguard local node resource or service metadata information, on the node of resource registering in the autonomous territory, makes that the resource of node or information on services are discerned by grid; For the service that is deployed in the node service container (b), nodal information service module (c) is collected its information automatically; Then import resource information for the resource that is not deployed in the node service container (b) by resource provider; The information of local node will periodically be registered or collect to nodal information service module (c) to the report of domain information service module simultaneously;
Node resource service module (d) is responsible for making resource to call for the territory job manager with service form to gridding resource (h) and the encapsulation of decision-making resource (j) service; Node resource service module (d) comprises computing node resource service module and memory node resource service module; Wherein computing node resource service module mainly is responsible for providing the calculation task in the grid service instantiation process to calculate required computing environment, and memory node resource service module mainly is responsible for providing the memory space in the calculation task desired data source in the grid service instantiation process;
All kinds of gridding resources and decision-making resource in this resource node are in charge of and are coordinated to node resource management services module (e), and the real-time resource control information of acceptance domain manager is to assist to finish the resource management requirement of the grid overall situation simultaneously;
Transmission service module (f) adopts grid file host-host protocol GridFTP, is responsible in the process of fulfiling assignment needed data transport service between storage resources node and computational resource node;
Monitoring resource service module (g) is responsible for that static properties and the dynamic performance parameter to resource on each resource node cluster monitors when system works, understands the load and the ruuning situation of whole mesh network network; Monitoring resource service module (g) is these dynamic and static information of real-time update periodically, carry out the reference information of autonomous territory internal burden balance as the territory job manager; Simultaneously, the resource performance that monitoring resource service module (g) is collected same application example utilizes situation, operating single grid application example is carried out Performance Evaluation, resource requirement and consumption situation in the reflection example running, the dynamic assignment and the scheduling of guiding work stream engine (1.2).
2. city bus information management and scheduling decision back-up system based on grid according to claim 1, it is characterized in that: system carries out grid service instantiation according to following flow process:
The 1st step subscriber authentication
The 1.1st step grid portal (1.1) is accepted the user certificate that the user provides, certificate information comprises Customs Assigned Number, name, login password and affiliated tissue, adopt X.509 the certificate of certification format standard to write, and transfer to authentication center (1.3) and be responsible for user's identity is verified;
The 1.2nd step authentication center (1.3) comprises Light Directory Access Protocol LDAP and the online certificate server of MyProxy; At first, authentication center (1.3) passes to ldap directory with the user certificate that receives, the passing user authentication information that writes down in this user certificate information and the ldap directory is compared, if compare successfully, just send the assertion message that an authentication is passed through to the user, if comparison is failed, then send the assertion message of an authentification failure to the user; Then, customer attribute information in the ldap directory query directory, certificate and attribute of user according to the user submits to send an attribute assertion message to the user, determine the authority of user capture system; Simultaneously, user oneself preserves and the process of management private cipher key and certificate file in order to simplify, and authentication center (1.3) uses the online certificate server of MyProxy, preserves and the leading subscriber certificate, for the user fetches, upgrades and create interim short-lived certificates;
The 2nd step information on services coupling
The 2.1st step domain information service module receives the service request that login user is submitted to, according to service request information the information on services in the autonomous territory is searched for coupling, and returns the WSDL mesh services description document of the traffic mesh services in the autonomous territory of satisfying request;
The 2.2nd step domain information service module is collected service status information in the domain node information service module (c) by the subscribing mode, with services selection, the distribution of support region job manager; Simultaneously, the domain information service module carries out data sync with the form of P2P to adjacent autonomous territory internal information service and duplicates;
The 3rd step workflow modeling
The 3.1st step workflow engine (1.2) provides a patterned editing interface assisted user to determine the procedure relation between each service in the operation flow, carry out personalized abstract grid work flow model modeling, finish the foundation of one-to-one relationship between the service that searched and the activity in the workflow, and represent its concrete grid work flow with the form of BPEL;
The 3.2nd step workflow engine (1.2) obtains the concrete subjob carried out information according to the corresponding relation of service and subtask among the BPEL, and it is defined as the grid work that job description language JDL describes, and dynamically disposes the territory job manager;
The service assignment of the 4th step operation
What the territory job manager was accepted workflow engine (1.2) transmission is the grid work request JDL task description file of host-host protocol with Simple Object Access Protocol SOAP, fulfils assignment to the distribution of service according to operation address, job title, operation and service binding information among the JDL;
The instantiation of the 5th step service is disposed
If define in the 5.1st step JDL task description file be the user submit to write application program certainly, the territory job manager is at first downloaded this program in user's space so, the resource packet holding tool that adopts Axis to provide carries out the application service encapsulation to program, and according to the description of the WSDL in this Web service registration, installation, after service instantiation, again object code is signed, prevent to distort; If what define in the JDL task description file is the field of traffic service that system has developed, the territory job manager is directly located the position of this service and is carried out instantiation operation so;
The 5.2nd step territory job manager sends data transfer request to suitable data node resource service module (d) according to the demand information of data source in the job description; Simultaneously, performed service decomposition is become several calculation tasks parallel or serial, according to the requirement of service and the specifying information of idling-resource, the computing node resource service module of selecting to satisfy the minimum requirement of service (d) participates in calculating, and calculation task is dispatched to computing node resource service module (d) the wait transfer of data that participates in calculating;
The visit of the 6th step service data source
The data transfer request that node service container (b) acceptance region job manager sends is created back end resource service module (d), according to data and the file in the request visit memory node, and is transferred to the corresponding computational resource node of territory job manager appointment; Wherein data access is realized by the data access interface OGSA-DAI of Open Grid Services Architecture, comprises inquiry, expression conversion and transmits three class activities;
The transmission of the 7th step service data source
Transmission service module (f) is realized the transfer of data between data source memory node resource service module (d) and computing node resource service module (d), set according to user's the transmission demand information and actual loading, network condition, the definite attribute that transmits of replica management mechanism of storage resources, transfer data to the Practical Calculation node resource service module (d) that the territory job manager distributes;
The execution and the monitoring of the service of the 8th step
Appointment computing node service container (b) in the 8.1st step grid is downloaded code execution environments and registration is installed from the territory job manager, and as the computing node resource service module (d) in the grid, the transmission of waiting for desired data is to carry out calculation task;
The mobile deployment agency that the 8.2nd step territory job manager is created is used to monitor distribution, execution and the last termination of the calculation task that belongs to same calculation procedure;
The 8.3rd each computational resource node resource service module (d) of step is carried out calculation task according to the calculation procedure of disposing after obtaining calculated data, act on behalf of condition report feedback and transfer to the territory job manager for user monitoring and management to moving to dispose at any time;
The service result storage of the 9th step
The territory job manager compiles result of calculation and transfers in the system database by transmission service module (f);
The 10th step service result is showed
Grid portal (1.1) obtains the result of calculation that is stored in the system database, and the form by User represents to the user;
Carry out in the whole flow process of service instantiation in system, each domain manager is responsible for memory node resource in the autonomous territory and computing node resource are managed, carry out the mutual of resource information with the node resource management services module (e) of lower floor, the withdrawing from and add of the resource in the management system in the resource node.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2009100627939ACN101587639B (en) | 2009-06-23 | 2009-06-23 | City bus information management and dispatch decision support system based on network |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2009100627939ACN101587639B (en) | 2009-06-23 | 2009-06-23 | City bus information management and dispatch decision support system based on network |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101587639A CN101587639A (en) | 2009-11-25 |
| CN101587639Btrue CN101587639B (en) | 2010-09-01 |
Family
ID=41371872
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2009100627939AExpired - Fee RelatedCN101587639B (en) | 2009-06-23 | 2009-06-23 | City bus information management and dispatch decision support system based on network |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101587639B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103716280B (en)* | 2012-09-28 | 2018-09-04 | 腾讯科技（深圳）有限公司 | data transmission method, server and system |
Families Citing this family (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101741904B (en)* | 2009-11-27 | 2013-01-02 | 中国林业科学研究院资源信息研究所 | Method for building distributed space computation service node and gateway device |
| CN102111452B (en)* | 2011-03-04 | 2013-04-17 | 天泽信息产业股份有限公司 | System for storing vehicle-mounted information by using distributed data storage program and storage method thereof |
| CN103036927A (en)* | 2011-09-29 | 2013-04-10 | 中国电信股份有限公司 | Method, device and system of intelligent traffic control |
| CN103034534A (en)* | 2011-09-29 | 2013-04-10 | 阿尔斯通电网公司 | Electric power system analysis parallel computing method and system based on grid computation |
| CN102750822B (en)* | 2012-06-26 | 2014-12-17 | 安科智慧城市技术（中国）有限公司 | Intelligent traffic service processing system and service processing method |
| CN104754008B (en) | 2013-12-26 | 2019-03-08 | 伊姆西公司 | Network storage node, network store system and the device and method for network storage node |
| CN104850947A (en)* | 2015-05-07 | 2015-08-19 | 国家计算机网络与信息安全管理中心 | Gridded multi-service procedure unified management method and device |
| CN107786355A (en)* | 2016-08-26 | 2018-03-09 | 南京中兴软件有限责任公司 | A kind of method and apparatus of smart city information sharing |
| DE102016216602B4 (en)* | 2016-09-02 | 2020-02-06 | Audi Ag | Method for assisting a user in operating a motor vehicle and data server device external to the motor vehicle |
| CN109677465B (en)* | 2018-12-29 | 2024-07-16 | 卡斯柯信号有限公司 | Distributed real-time system architecture for rail transit integrated monitoring system |
| CN112433808B (en)* | 2020-11-03 | 2024-06-21 | 深圳市永达电子信息股份有限公司 | Network security event detection system and method based on grid computing |
| CN113259416B (en)* | 2021-04-21 | 2024-08-06 | 吴晓东 | Extensible computer system for large-scale computing service |
| CN113612818B (en)* | 2021-07-09 | 2023-09-01 | 中国汽车技术研究中心有限公司 | Industrial app release system of low-code platform |
| CN114549259A (en)* | 2022-02-23 | 2022-05-27 | 中科海慧（北京）科技有限公司 | Smart city optimization management method based on multi-source data fusion |
| CN115237608A (en)* | 2022-09-21 | 2022-10-25 | 之江实验室 | A multi-mode scheduling system and method based on multi-cluster unified computing power |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050283786A1 (en)* | 2004-06-17 | 2005-12-22 | International Business Machines Corporation | Optimizing workflow execution against a heterogeneous grid computing topology |
| CN101123551A (en)* | 2007-08-07 | 2008-02-13 | 刘靖宇 | An intelligent bus system based on communication and grid computing technology |
- 2009
- 2009-06-23CNCN2009100627939Apatent/CN101587639B/ennot_activeExpired - Fee Related
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050283786A1 (en)* | 2004-06-17 | 2005-12-22 | International Business Machines Corporation | Optimizing workflow execution against a heterogeneous grid computing topology |
| CN101123551A (en)* | 2007-08-07 | 2008-02-13 | 刘靖宇 | An intelligent bus system based on communication and grid computing technology |
Non-Patent Citations (2)
| Title |
|---|
| 刘冲等.基于网格的交通管理决策支持系统研究与涉及.《交通与计算机》.2006,第24卷(第1期),51-53.* |
| 高博等.网格技术在智能公交系统中的应用.《微计算机应用》.2007,第28卷(第10期),1043-1046.* |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103716280B (en)* | 2012-09-28 | 2018-09-04 | 腾讯科技（深圳）有限公司 | data transmission method, server and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101587639A (en) | 2009-11-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101587639B (en) | City bus information management and dispatch decision support system based on network | |
| CN103401917B (en) | A kind of mixing cloud computing system and its implementation method based on cloud bus | |
| CN103297507B (en) | Cloud computing operation system and the method for providing a user service | |
| CN103281368B (en) | A kind of data share exchange system based on cloud computing | |
| Fan et al. | Manufacturing grid: needs, concept, and architecture | |
| Zou et al. | Design and implementation of hybrid cloud computing architecture based on cloud bus | |
| CN102024204A (en) | Constructing method of reliability design analysis service system of service oriented architecture | |
| CN113377344B (en) | A Comprehensive Integration Method of Complex Information System | |
| CN101741614A (en) | Equivalent type node manager and equivalent type node management method | |
| CN114676179A (en) | Multi-source heterogeneous data interaction and fusion method and system for shield scene | |
| Yu et al. | Design of cloud computing and microservice-based urban rail transit integrated supervisory control system plus | |
| Li et al. | Shanghaigrid: an information service grid | |
| Vázquez et al. | Evaluation of a utility computing model based on the federation of grid infrastructures | |
| Zhu et al. | A service-oriented city portal framework and collaborative development platform | |
| CN113822557A (en) | Data fusion management system, data fusion management device, electronic device, and medium | |
| Qin et al. | Construction of E-government data sharing framework based on big data technology | |
| Lyu et al. | A data middle platform architecture based on microservice serving power grid business | |
| CN111638941A (en) | Cross-domain shelter computing system and method based on data resource distribution | |
| Liu | Typical characteristics of cloud GIS and several key issues of cloud spatial decision support system | |
| Padberg et al. | Towards a grid-enabled SDI: Matching the paradigms of OGC Web Services and Grid Computing | |
| CN102929605A (en) | Cloud-computing-based open interface of data mining system | |
| Bai et al. | Research on Information System Architecture Based on Microservice Architecture | |
| Zhao et al. | A real-time processing system for massive traffic sensor data | |
| Huang et al. | Smart park integrated management cloud platform architecture based on microservice governance framework | |
| Zhang et al. | Design of M2M Platform Based on J2EE and SOA |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C17 | Cessation of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee | Granted publication date:20100901 Termination date:20130623 |