CN114564475A - Integration method, system and storage medium of multi-source heterogeneous data - Google Patents
Integration method, system and storage medium of multi-source heterogeneous dataDownload PDFInfo
- Publication number
- CN114564475A CN114564475ACN202210073227.3ACN202210073227ACN114564475ACN 114564475 ACN114564475 ACN 114564475ACN 202210073227 ACN202210073227 ACN 202210073227ACN 114564475 ACN114564475 ACN 114564475A
- Authority
- CN
- China
- Prior art keywords
- data
- oslc
- service
- object model
- unified
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2291—User-Defined Types; Storage management thereof
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
- G06F16/24553—Query execution of query operations
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Software Systems (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
Translated fromChinese
Description
Translated fromChinese技术领域technical field
本发明涉及数据处理技术领域，特别涉及一种多源异构数据的集成方法、系统及存储介质。The invention relates to the technical field of data processing, in particular to a method, system and storage medium for integrating multi-source heterogeneous data.
背景技术Background technique
随着信息技术的蓬勃发展，钢结构制造业逐步从传统制造向智能制造转型，钢结构生产制造装备及其信息系统越来越强大，相关产品的复杂程度也在增加，在产品的各个生命周期阶段往往会跨越多个工程领域，除了基础的钢结构生产制造外，还会涉及需求管理、产品设计、质量管理等。为了解决不同领域的问题，会引入不同的工具，而这些工具往往具备不同的数据类型、依赖不同的数据库与平台或者拥有不同的UI和风格。不同的应用系统之间必然会形成彼此隔离的信息孤岛，这就导致领域工具间的数据和工作流彼此割裂，无法在钢结构产品的全生命周期内实现跨领域的数据一致性表达和相互通用。这导致了在整合分析阶段，产品开发人员不得不投入大量的人力用于整合不同平台工具间的数据。并且随着工业数字化的发展，数字孪生技术对于钢结构生产的发展也极为重要，这种贯穿整个产品生命周期的虚拟数据，同样需要统一的表达和管理。With the vigorous development of information technology, the steel structure manufacturing industry is gradually transforming from traditional manufacturing to intelligent manufacturing. Steel structure manufacturing equipment and its information systems are becoming more and more powerful, and the complexity of related products is also increasing. The stages often span multiple engineering fields, and in addition to the basic steel structure manufacturing, requirements management, product design, quality management, etc. are also involved. In order to solve problems in different fields, different tools are introduced, and these tools often have different data types, rely on different databases and platforms, or have different UIs and styles. Different application systems will inevitably form isolated information islands, which leads to the separation of data and workflow between domain tools, and it is impossible to achieve cross-domain data consistency expression and interoperability in the full life cycle of steel structure products. . This leads to the integration analysis phase, product developers have to invest a lot of manpower to integrate data between different platform tools. And with the development of industrial digitization, digital twin technology is also extremely important for the development of steel structure production. This virtual data throughout the entire product life cycle also requires unified expression and management.
因此，如何整合钢结构生产全生命周期的异构数据是本领域技术人员亟待解决的技术问题。Therefore, how to integrate heterogeneous data of the whole life cycle of steel structure production is a technical problem to be solved urgently by those skilled in the art.
发明内容SUMMARY OF THE INVENTION
本申请实施例提供了一种多源异构数据的集成方法、系统及存储介质。为了对披露的实施例的一些方面有一个基本的理解，下面给出了简单的概括。该概括部分不是泛泛评述，也不是要确定关键/重要组成元素或描绘这些实施例的保护范围。其唯一目的是用简单的形式呈现一些概念，以此作为后面的详细说明的序言。Embodiments of the present application provide a method, system, and storage medium for integrating multi-source heterogeneous data. In order to provide a basic understanding of some aspects of the disclosed embodiments, a brief summary is given below. This summary is not intended to be an extensive review, nor is it intended to identify key/critical elements or delineate the scope of protection of these embodiments. Its sole purpose is to present some concepts in a simplified form as a prelude to the detailed description that follows.
第一方面，本申请实施例提供了一种多源异构数据的集成系统，包括：In a first aspect, an embodiment of the present application provides an integrated system for multi-source heterogeneous data, including:
数据基础组件模块，用于获取钢结构生产全生命周期中多个数据源的配置信息，并将多个数据源的配置信息保存至数据源列表；The data base component module is used to obtain the configuration information of multiple data sources in the whole life cycle of steel structure production, and save the configuration information of multiple data sources to the data source list;
OSLC服务处理模块，用于为多个数据源中的对象创建对象模型，并为每个对象模型创建OSLC服务；OSLC service processing module for creating object models for objects in multiple data sources, and creating OSLC services for each object model;
数据调用模块，用于根据多个对象模型创建统一对象模型，并生成统一OSLC服务，根据客户端指令调用统一OSLC服务，返回客户端待查询的数据。The data calling module is used to create a unified object model according to multiple object models, generate a unified OSLC service, call the unified OSLC service according to the client's instruction, and return the data to be queried by the client.
在一个实施例中，数据基础组件模块，包括：In one embodiment, the data foundation component module includes:
数据获取单元，用于获取钢结构生产全生命周期中多个数据源的配置信息，配置信息包括数据源的类型信息、名称信息、连接地址信息、用户名信息以及密码信息；The data acquisition unit is used to acquire the configuration information of multiple data sources in the whole life cycle of steel structure production, and the configuration information includes data source type information, name information, connection address information, user name information and password information;
数据注册单元，用于根据数据源的配置信息测试数据源是否能连接成功，将连接成功的数据源的配置信息保存至数据源列表。The data registration unit is used to test whether the data source can be successfully connected according to the configuration information of the data source, and save the configuration information of the successfully connected data source to the data source list.
在一个实施例中，OSLC服务处理模块，包括：In one embodiment, the OSLC service processing module includes:
对象模型注册单元，用于根据多个数据源中的对象名称、模型描述配置信息，分别为每个数据源中的对象创建对象模型；The object model registration unit is used to create object models for the objects in each data source according to the object names and model description configuration information in multiple data sources;
指标配置单元，用于根据每个对象模型对应的属性信息分别为每个对象模型配置指标；The indicator configuration unit is used to configure indicators for each object model according to the attribute information corresponding to each object model;
服务配置单元，用于根据每个对象模型的接口信息分别为每个对象模型创建OSLC服务。The service configuration unit is used to create OSLC services for each object model according to the interface information of each object model.
在一个实施例中，指标配置单元，具体用于：In one embodiment, the indicator configuration unit is specifically used for:
根据对象模型对应的属性信息为每个对象模型配置原子指标；或，Configure atomic metrics for each object model according to the attribute information corresponding to the object model; or,
根据对象模型对应的属性信息为每个对象模型配置原子指标以及复合指标；或，Configure atomic indicators and composite indicators for each object model according to the attribute information corresponding to the object model; or,
根据对象模型对应的属性信息为每个对象模型配置原子指标以及派生指标；或，Configure atomic indicators and derived indicators for each object model according to the attribute information corresponding to the object model; or,
根据对象模型对应的属性信息为每个对象模型配置原子指标、复合指标以及派生指标；Configure atomic indicators, composite indicators and derived indicators for each object model according to the attribute information corresponding to the object model;
其中，原子指标为不可再分的业务实体属性，复合指标为原子指标基于业务需求经过预设的运算规则形成的计算指标，派生指标为原子指标或复合指标基于业务需求经过预设维度与预设条件的筛选、聚合形成的计算指标。Among them, the atomic index is an indivisible business entity attribute, the compound index is the calculation index formed by the atomic index through preset operation rules based on business requirements, and the derived index is the atomic index or compound index based on the business requirements through preset dimensions and presets. Filtering of conditions, calculation indicators formed by aggregation.
在一个实施例中，服务配置单元，具体用于：In one embodiment, the service configuration unit is specifically used for:
接收OSLC服务接口名、接口描述以及请求方法中的一种或多种接口配置信息；Receive one or more interface configuration information among OSLC service interface name, interface description and request method;
根据接口配置信息创建接口函数，并根据数据集成需求定义函数体，将创建好的函数体注册至计算引擎中，生成OSLC服务。Create an interface function according to the interface configuration information, define a function body according to data integration requirements, register the created function body in the computing engine, and generate an OSLC service.
在一个实施例中，数据调用模块，包括：In one embodiment, the data call module includes:
通用接口配置单元，用于根据多个对象模型创建统一对象模型，并生成统一OSLC服务；A generic interface configuration unit for creating a unified object model based on multiple object models and generating a unified OSLC service;
数据调用单元，用于根据客户端指令调用统一OSLC服务，返回客户端待查询的数据。The data calling unit is used to call the unified OSLC service according to the client's instruction, and return the data to be queried by the client.
在一个实施例中，通用接口配置单元具体用于：In one embodiment, the generic interface configuration unit is specifically used to:
获取所有的OSLC对象模型，以一一映射的方式存储OSLC对象模型名称、对应的OSLC服务名称以及OSLC服务地址，作为统一OSLC对象模型的数据源；Obtain all OSLC object models, and store the OSLC object model name, corresponding OSLC service name and OSLC service address in a one-to-one mapping manner, as the data source of the unified OSLC object model;
根据存储的统一OSLC对象模型的数据源创建统一OSLC对象模型，并根据各个对象模型的名称、对应的OSLC服务名称以及OSLC服务地址进行指标的配置；Create the unified OSLC object model according to the stored data source of the unified OSLC object model, and configure the indicators according to the name of each object model, the corresponding OSLC service name and the OSLC service address;
根据配置的统一OSLC对象模型的接口信息以及请求方式信息生成统一OSLC服务。The unified OSLC service is generated according to the configured interface information and request mode information of the unified OSLC object model.
在一个实施例中，数据调用单元，具体用于：In one embodiment, the data calling unit is specifically used for:
接收客户端的数据调用指令；Receive data call instructions from the client;
根据数据调用指令调用统一OSLC服务，根据统一OSLC服务查找到与数据调用指令对应的OSLC服务，调用查找到的OSLC服务，返回客户端待查询的数据；Call the unified OSLC service according to the data call instruction, find the OSLC service corresponding to the data call instruction according to the unified OSLC service, call the found OSLC service, and return the data to be queried by the client;
将返回的待查询数据以客户端预设的格式进行展示。Display the returned data to be queried in the format preset by the client.
第二方面，本公开实施例提供了一种多源异构数据的集成方法，包括：In a second aspect, an embodiment of the present disclosure provides a method for integrating multi-source heterogeneous data, including:
获取钢结构生产全生命周期中多个数据源的配置信息，并将多个数据源的配置信息保存至数据源列表；Obtain the configuration information of multiple data sources in the whole life cycle of steel structure production, and save the configuration information of multiple data sources to the data source list;
为多个数据源中的对象创建对象模型，并为每个对象模型创建OSLC服务；Create object models for objects in multiple data sources, and create OSLC services for each object model;
根据多个对象模型创建统一对象模型，并生成统一OSLC服务，根据客户端指令调用统一OSLC服务，返回客户端待查询的数据。Create a unified object model based on multiple object models, generate a unified OSLC service, call the unified OSLC service according to client instructions, and return the data to be queried by the client.
第三方面，本公开实施例提供了一种计算机可读介质，其上存储有计算机可读指令，计算机可读指令被处理器执行以实现上述实施例提供的一种多源异构数据的集成方法。In a third aspect, embodiments of the present disclosure provide a computer-readable medium on which computer-readable instructions are stored, and the computer-readable instructions are executed by a processor to implement the integration of multi-source heterogeneous data provided by the foregoing embodiments method.
本申请实施例提供的技术方案可以包括以下有益效果：The technical solutions provided by the embodiments of the present application may include the following beneficial effects:
根据本申请实施例提供的多源异构数据的集成方法，使得钢结构生产生命周期过程中的数据、模型、形式化文档以及数据孪生中产生的数据可以统一表达，具有良好的扩展性。若要集成其它工具的数据，只需要根据统一的通用接口实现该工具的OSLC服务，不会对其它工具的数据集成产生影响。提供了一种通用的、可扩展的数据集成方式，大大提升了整个钢结构生产生命周期的数据管理、整合能力，降低了研发过程中的交流、管理成本，提高产品研发效率。According to the multi-source heterogeneous data integration method provided by the embodiment of the present application, the data, models, formal documents and data generated in the data twin in the steel structure production life cycle process can be expressed uniformly, with good scalability. To integrate the data of other tools, it is only necessary to implement the OSLC service of the tool according to the unified common interface, and it will not affect the data integration of other tools. It provides a general and scalable data integration method, which greatly improves the data management and integration capabilities of the entire steel structure production life cycle, reduces the communication and management costs in the research and development process, and improves the efficiency of product research and development.
应当理解的是，以上的一般描述和后文的细节描述仅是示例性和解释性的，并不能限制本发明。It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention.
附图说明Description of drawings
此处的附图被并入说明书中并构成本说明书的一部分，示出了符合本发明的实施例，并与说明书一起用于解释本发明的原理。The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description serve to explain the principles of the invention.
图1是根据一示例性实施例示出的一种多源异构数据的集成系统的结构示意图；FIG. 1 is a schematic structural diagram of a multi-source heterogeneous data integration system according to an exemplary embodiment;
图2是根据一示例性实施例示出的一种数据基础组件模块获取的数据示意图；2 is a schematic diagram of data acquired by a data base component module according to an exemplary embodiment;
图3是根据一示例性实施例示出的一种数据基础组件模块测试数据的示意图；3 is a schematic diagram of test data of a data foundation component module according to an exemplary embodiment;
图4是根据一示例性实施例示出的一种OSLC服务处理模块的结构示意图；4 is a schematic structural diagram of an OSLC service processing module according to an exemplary embodiment;
图5是根据一示例性实施例示出的一种指标配置的示意图；Fig. 5 is a schematic diagram showing an indicator configuration according to an exemplary embodiment;
图6是根据一示例性实施例示出的一种服务配置的示意图；Fig. 6 is a schematic diagram showing a service configuration according to an exemplary embodiment;
图7是根据一示例性实施例示出的一种OSLC服务处理过程的示意图；FIG. 7 is a schematic diagram of an OSLC service processing procedure according to an exemplary embodiment;
图8是根据一示例性实施例示出的一种数据调用模块的示意图；8 is a schematic diagram of a data calling module according to an exemplary embodiment;
图9是根据一示例性实施例示出的一种通用接口配置模块处理流程的示意图；FIG. 9 is a schematic diagram illustrating a processing flow of a general interface configuration module according to an exemplary embodiment;
图10是根据一示例性实施例示出的一种计算机存储介质的示意图。FIG. 10 is a schematic diagram of a computer storage medium according to an exemplary embodiment.
具体实施方式Detailed ways
以下描述和附图充分地示出本发明的具体实施方案，以使本领域的技术人员能够实践它们。The following description and drawings sufficiently illustrate specific embodiments of the invention to enable those skilled in the art to practice them.
应当明确，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其它实施例，都属于本发明保护的范围。It should be understood that the described embodiments are only some, but not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.
下面的描述涉及附图时，除非另有表示，不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本发明相一致的所有实施方式。相反，它们仅是如所附权利要求书中所详述的、本发明的一些方面相一致的系统和方法的例子。When the following description refers to the drawings, the same numerals in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the illustrative examples below are not intended to represent all implementations consistent with the present invention. Rather, they are merely examples of systems and methods consistent with some aspects of the invention, as recited in the appended claims.
通常，不同的应用系统之间必然会形成彼此隔离的信息孤岛，这就导致领域工具间的数据和工作流彼此割裂，无法在钢结构产品的全生命周期内实现跨领域的数据一致性表达和相互通用。这导致了在整合分析阶段，产品开发人员不得不投入大量的人力用于整合不同平台工具间的数据。并且随着工业数字化的发展，数字孪生技术对于钢结构生产的发展也极为重要，这种贯穿整个产品生命周期的虚拟数据，同样需要统一的表达和管理。Usually, information islands that are isolated from each other are bound to form between different application systems, which leads to the separation of data and workflow between domain tools, and it is impossible to achieve cross-domain data consistency expression and common to each other. This leads to the integration analysis phase, product developers have to invest a lot of manpower to integrate data between different platform tools. And with the development of industrial digitization, digital twin technology is also extremely important for the development of steel structure production. This virtual data throughout the entire product life cycle also requires unified expression and management.
基于此，本申请实施例提供了一种多源异构数据的集成系统，能够整合钢结构生产全生命周期的异构数据，制定统一的标准和规范，支持实时数据的集成和管理，提升了数据管理、整合能力，降低了研发过程中的交流、管理成本，加快了产品研发效率。Based on this, the embodiments of the present application provide an integrated system for multi-source heterogeneous data, which can integrate heterogeneous data in the whole life cycle of steel structure production, formulate unified standards and specifications, support the integration and management of real-time data, and improve the Data management and integration capabilities reduce communication and management costs in the R&D process and accelerate product R&D efficiency.
下面将结合附图对本申请实施例提供的多源异构数据的集成系统进行详细介绍。参见图1，该系统具体包括以下模块。The integrated system for multi-source heterogeneous data provided by the embodiments of the present application will be described in detail below with reference to the accompanying drawings. Referring to Figure 1, the system specifically includes the following modules.
A1、数据基础组件模块，用于获取钢结构生产全生命周期中多个数据源的配置信息，并将多个数据源的配置信息保存至数据源列表。A1. The data base component module is used to obtain the configuration information of multiple data sources in the whole life cycle of steel structure production, and save the configuration information of multiple data sources to the data source list.
在一个实施例中，数据基础组件模块包括数据获取单元，用于获取钢结构生产全生命周期中多个数据源的配置信息，配置信息包括数据源的类型信息、名称信息、连接地址信息、用户名信息以及密码信息。In one embodiment, the data base component module includes a data acquisition unit for acquiring configuration information of multiple data sources in the entire life cycle of steel structure production, the configuration information includes type information, name information, connection address information, user name information and password information.
图2是示出的一种数据基础组件模块获取的数据源示意图，如图2所示，数据获取单元获取整个钢结构生产的全生命周期数据，包括项目生产管理数据、质量管理数据、文件数据、设计模型数据、用户权限数据等多种数据，将不同类型的数据源直接存储于不同的数据库中。还包括获取数字孪生数据，例如工业生产设备数据、传感器数据等，将采集的多个工业数据由模拟量转化为数字量后，上传至计算机，由计算机存储至指定数据库中。Fig. 2 is a schematic diagram of a data source acquired by a data base component module. As shown in Fig. 2, the data acquisition unit acquires the whole life cycle data of the entire steel structure production, including project production management data, quality management data, and file data , design model data, user permission data and other data, and store different types of data sources directly in different databases. It also includes acquiring digital twin data, such as industrial production equipment data, sensor data, etc., after converting multiple collected industrial data from analog to digital, uploading them to a computer, and storing them in a designated database by the computer.
进一步地，获取多个数据源的配置信息，配置信息包括数据源的类型信息、名称信息、数据库连接地址信息、用户名信息以及密码信息等。Further, the configuration information of multiple data sources is acquired, where the configuration information includes type information, name information, database connection address information, user name information, password information and the like of the data sources.
本申请实施例中的数据基础组件模块还包括数据注册单元，用于根据数据源的配置信息测试数据是否能连接成功，若能连接成功，则将多个数据源的配置信息保存至数据源列表。The data base component module in the embodiment of the present application further includes a data registration unit, configured to test whether the data can be successfully connected according to the configuration information of the data source, and if the connection is successful, save the configuration information of the multiple data sources to the data source list .
图3是示出的一种数据基础组件模块测试数据的示意图，如图3所示，首先获取数据源的配置信息，根据配置信息中的数据库连接地址以及登录密码等信息测试是否能成功连接对应的数据库，若测试通过，证明配置信息中的连接地址、密码等信息是正确的，则将多个数据源的配置信息保存至数据源列表，供后续调用。Fig. 3 is a schematic diagram showing the test data of a data base component module. As shown in Fig. 3, first obtain the configuration information of the data source, and test whether the corresponding connection can be successfully connected according to the database connection address and login password in the configuration information. If the test passes, it proves that the connection address, password and other information in the configuration information are correct, then save the configuration information of multiple data sources to the data source list for subsequent calls.
A2、OSLC服务处理模块，用于为多个数据源中的对象创建对象模型，并为每个对象模型创建OSLC服务。A2. The OSLC service processing module is used to create object models for objects in multiple data sources, and create OSLC services for each object model.
图4是示出的一种OSLC服务处理模块的结构示意图，如图4所示，OSLC服务处理模块包括对象模型注册单元，用于根据多个数据源中的对象名称、模型描述配置信息，为每个对象创建对象模型。FIG. 4 is a schematic structural diagram of an OSLC service processing module. As shown in FIG. 4 , the OSLC service processing module includes an object model registration unit, which is used to describe configuration information according to object names and models in multiple data sources, for Each object creates an object model.
在一种可能的实现方式中，根据存储的多个数据源，得到钢结构生产全生命周期的数据涉及的多个对象，例如温度传感器、某生产设备、某设计模型、某用户、某生产项目等多个对象。为每个对象配置对象名称、对象描述等信息，建立对象模型。In a possible implementation, according to multiple stored data sources, multiple objects involved in the data of the whole life cycle of steel structure production are obtained, such as temperature sensors, a certain production equipment, a certain design model, a certain user, a certain production project and more objects. Configure the object name, object description and other information for each object, and establish an object model.
还包括指标配置单元，用于根据每个对象模型对应的属性信息为每个对象模型配置指标。It also includes an indicator configuration unit for configuring indicators for each object model according to the attribute information corresponding to each object model.
具体地，可以根据对象模型对应的属性信息为每个对象模型配置原子指标。其中，原子指标为不可再分的业务实体属性信息，例如，原子指标为温度传感器测量的温度、单日的产值、单日的成本。Specifically, an atomic indicator can be configured for each object model according to attribute information corresponding to the object model. Among them, the atomic indicator is the attribute information of the business entity that cannot be further divided. For example, the atomic indicator is the temperature measured by the temperature sensor, the output value of a single day, and the cost of a single day.
可选地，还可以根据对象模型对应的属性信息为每个对象模型配置原子指标以及复合指标，其中，复合指标为原子指标基于业务需求经过一定运算规则形成的计算指标。例如，复合指标为单日的利润，等于单日的产值减去单日的成本，根据计算所需的原子指标，结合运算符号生成复合指标计算函数。Optionally, an atomic indicator and a composite indicator may also be configured for each object model according to attribute information corresponding to the object model, wherein the composite indicator is a calculation indicator formed by the atomic indicator through certain operation rules based on business requirements. For example, the composite indicator is the profit of a single day, which is equal to the output value of a single day minus the cost of a single day. According to the atomic indicators required for the calculation, the composite indicator calculation function is generated by combining the operation symbols.
可选地，还可以根据对象模型对应的属性信息为每个对象模型配置原子指标以及派生指标，或根据对象模型对应的属性信息为每个对象模型配置原子指标、复合指标以及派生指标。其中，派生指标为原子指标或复合指标基于业务需求经过预设维度与预设条件的筛选、聚合形成的计算指标。例如，派生指标为4月份的利润，那么派生指标由4月份的单日利润和4月份的日期共同组成，例如，纵坐标为单日利润值，横坐标为日期，通过筛选、聚合形成的二维计算指标。Optionally, atomic indicators and derived indicators may also be configured for each object model according to attribute information corresponding to the object models, or atomic indicators, composite indicators and derived indicators may be configured for each object model according to the attribute information corresponding to the object models. Wherein, the derived index is a calculation index formed by an atomic index or a composite index through screening and aggregation of preset dimensions and preset conditions based on business requirements. For example, if the derived indicator is the profit in April, then the derived indicator is composed of the single-day profit in April and the date in April. For example, the ordinate is the single-day profit value, and the abscissa is the date. Dimension calculation metrics.
图5是根据一示例性实施例示出的一种指标配置的示意图，如图5所示，可以进行原子指标的配置、复合指标的配置以及派生指标的配置，通过为每个对象模型配置指标，可得到每个对象模型可以计算哪些指标。进而调用数据库中的数据，进行计算，实现数据同步。Fig. 5 is a schematic diagram showing an indicator configuration according to an exemplary embodiment. As shown in Fig. 5, atomic indicator configuration, compound indicator configuration, and derived indicator configuration can be performed. By configuring indicators for each object model, Which metrics can be calculated for each object model. Then call the data in the database, perform calculation, and realize data synchronization.
还包括服务配置单元，用于根据每个对象模型的接口信息为每个对象模型创建OSLC服务。Also includes a service configuration unit for creating OSLC services for each object model based on the interface information for each object model.
在一种可能的实现方式中，得到每个对象模型可以计算哪些指标后，还需调用数据库中的数据进行指标计算。因此，需要给每个对象模型配置调用数据的接口，也就是配置OSLC服务，其中，每个对象模型可以有一个或多个OSLC服务。In a possible implementation manner, after obtaining which indicators can be calculated by each object model, the data in the database needs to be called to calculate the indicators. Therefore, an interface for invoking data needs to be configured for each object model, that is, configuring an OSLC service, wherein each object model may have one or more OSLC services.
图6是根据一示例性实施例示出的一种服务配置的示意图，如图6所示，首先，接收OSLC服务接口名、接口描述、请求方法等接口配置信息，创建接口函数，并根据数据集成需求定义函数体，函数体中可对指标配置模块中的原子指标、复合指标或派生指标进行操作，也可以根据需求添加其他的函数，将创建好的函数体注册至计算引擎中，生成OSLC服务。FIG. 6 is a schematic diagram of a service configuration according to an exemplary embodiment. As shown in FIG. 6 , first, interface configuration information such as OSLC service interface name, interface description, request method, etc. is received, an interface function is created, and according to data integration The function body needs to be defined. In the function body, the atomic indicators, compound indicators or derived indicators in the indicator configuration module can be operated. Other functions can also be added according to the requirements, and the created function body can be registered in the calculation engine to generate the OSLC service. .
图7是根据一示例性实施例示出的一种OSLC服务处理过程的示意图，如图7所示，本申请实施例中的OSLC服务处理模块，首先，通过OSLC对象模型注册单元为数据基础组件模块中的生命周期数据和数字孪生数据建立OSLC对象模型；进一步地，通过指标配置单元为OSLC对象模型配置指标；最后，通过OSLC服务配置单元创建OSLC服务，通过OSLC服务实现对数据库中的数据查询并返回。FIG. 7 is a schematic diagram illustrating an OSLC service processing process according to an exemplary embodiment. As shown in FIG. 7 , the OSLC service processing module in this embodiment of the present application firstly registers the unit through the OSLC object model as a data base component module The OSLC object model is established with the life cycle data and digital twin data in return.
A3、数据调用模块，用于根据多个对象模型创建统一对象模型，并生成统一OSLC服务，根据客户端指令调用统一OSLC服务，返回客户端待查询的数据。A3. The data calling module is used to create a unified object model according to multiple object models, generate a unified OSLC service, call the unified OSLC service according to the client's instruction, and return the data to be queried by the client.
图8是根据一示例性实施例示出的一种数据调用模块的示意图，如图8所示，数据调用模块包括通用接口配置单元以及数据调用单元。FIG. 8 is a schematic diagram of a data calling module according to an exemplary embodiment. As shown in FIG. 8 , the data calling module includes a general interface configuration unit and a data calling unit.
具体地，通用接口配置单元，用于根据多个对象模型创建统一对象模型，并生成统一OSLC服务。Specifically, the generic interface configuration unit is used to create a unified object model according to multiple object models, and generate a unified OSLC service.
在一种可能的实现方式中，首先获取所有的OSLC对象模型，以一一映射的方式存储OSLC对象模型名称、对应的OSLC服务名称以及OSLC服务地址至数据库中，作为统一OSLC对象模型的数据源。In a possible implementation, first obtain all the OSLC object models, and store the OSLC object model name, the corresponding OSLC service name and the OSLC service address in the database in a one-to-one mapping manner, as the data source of the unified OSLC object model .
进一步地，根据存储的统一OSLC对象模型的数据源创建统一OSLC对象模型，并根据各个对象模型的名称、对应的OSLC服务名称以及OSLC服务地址进行指标的配置。例如，将子对象模型的名称、对应的OSLC服务名称以及OSLC服务地址作为原子指标，派生指标和复合指标可根据具体的业务需求进行配置，也可不配置。Further, the unified OSLC object model is created according to the stored data source of the unified OSLC object model, and the indicators are configured according to the name of each object model, the corresponding OSLC service name and the OSLC service address. For example, the name of the sub-object model, the corresponding OSLC service name, and the OSLC service address are used as atomic indicators, and the derived indicators and composite indicators may or may not be configured according to specific business requirements.
进一步地，根据配置的统一OSLC对象模型的接口信息以及请求方式信息生成统一OSLC服务。其中请求方式信息为入参信息，包括子对象名称和所需要的服务名称。Further, the unified OSLC service is generated according to the configured interface information and request mode information of the unified OSLC object model. The request method information is the input parameter information, including the sub-object name and the required service name.
在一种可能的实现方式中，设置入参为子对象名称和所需要的服务名称，统一OSLC服务接收到这两个参数以后，先根据子对象模型名称查找到对应的子对象模型，然后根据服务名称在该子对象的所有OSLC服务中查找到对应的服务地址，然后调用该服务，将得到的查询数据返回。In a possible implementation, set the input parameters as the sub-object name and the required service name. After the unified OSLC service receives these two parameters, it first finds the corresponding sub-object model according to the sub-object model name, and then according to the sub-object model name The service name finds the corresponding service address in all the OSLC services of the sub-object, then calls the service, and returns the obtained query data.
图9是示出的一种通用接口配置单元处理流程的示意图，如图9所示，首先获取钢结构生产全生命周期数据以及数字孪生数据中的多个OSLC对象模型，以一一映射的方式存储OSLC对象模型名称、对应的OSLC服务名称以及OSLC服务地址至数据库中，作为统一OSLC对象模型的数据源。根据存储的统一OSLC对象模型的数据源创建统一OSLC对象模型，并生成统一OSLC服务。根据生成的OSLC服务，返回统一表达的OSLC形式化数据。Fig. 9 is a schematic diagram showing the processing flow of a general interface configuration unit. As shown in Fig. 9, first obtain the full life cycle data of steel structure production and multiple OSLC object models in the digital twin data, and map them one by one. Store the OSLC object model name, the corresponding OSLC service name and the OSLC service address in the database as a data source for the unified OSLC object model. The unified OSLC object model is created according to the stored data source of the unified OSLC object model, and the unified OSLC service is generated. According to the generated OSLC service, return the OSLC formalized data expressed uniformly.
其中，数据调用单元，用于根据客户端指令调用统一OSLC服务，返回客户端待查询的数据。The data calling unit is used to call the unified OSLC service according to the client's instruction, and return the data to be queried by the client.
具体地，接收客户端的数据调用指令，根据数据调用指令调用统一OSLC服务，数据调用指令中包含OSLC对象名称以及所需要的服务名称，统一OSLC服务接收到这两个参数以后，先根据子对象模型名称查找到对应的子对象模型，然后根据服务名称在该子对象模型的所有服务中查找到对应的服务地址，调用查找到的OSLC服务，返回客户端待查询的数据。Specifically, the data call instruction from the client is received, and the unified OSLC service is called according to the data call instruction. The data call instruction contains the name of the OSLC object and the required service name. After the unified OSLC service receives these two parameters, it firstly uses the sub-object model Find the corresponding sub-object model by name, then find the corresponding service address in all services of the sub-object model according to the service name, call the found OSLC service, and return the data to be queried by the client.
进一步地，将返回的待查询数据以客户端预设的格式进行展示。例如，可以将返回的数据在客户端进行图表可视化展示，还可以在客户端进行数据分析。Further, the returned data to be queried is displayed in a format preset by the client. For example, the returned data can be displayed graphically on the client side, and data analysis can be performed on the client side.
根据本申请实施例提供的多源异构数据的集成系统，基于通用数据接口对钢结构的生产数据进行集成，使得钢结构生产全生命周期中的数据以及数据孪生中的数据进行统一表达，制定统一的标准和规范，具有良好的扩展性，支持实时数据的集成和管理，大大提升了数据管理、整合能力，降低研发过程中的交流、管理成本，加快产品研发效率。According to the multi-source heterogeneous data integration system provided by the embodiment of the present application, the production data of the steel structure is integrated based on the general data interface, so that the data in the whole life cycle of the steel structure production and the data in the data twin can be expressed uniformly, and the formula Unified standards and specifications have good scalability, support real-time data integration and management, greatly improve data management and integration capabilities, reduce communication and management costs in the R&D process, and speed up product R&D efficiency.
本申请实施例还提供一种多源异构数据的集成方法，该方法包括：Embodiments of the present application also provide a method for integrating multi-source heterogeneous data, the method comprising:
获取钢结构生产全生命周期中多个数据源的配置信息，并将多个数据源的配置信息保存至数据源列表；Obtain the configuration information of multiple data sources in the whole life cycle of steel structure production, and save the configuration information of multiple data sources to the data source list;
为多个数据源中的对象创建对象模型，并为每个对象模型创建OSLC服务；Create object models for objects in multiple data sources, and create OSLC services for each object model;
根据多个对象模型创建统一对象模型，并生成统一OSLC服务，根据客户端指令调用统一OSLC服务，返回客户端待查询的数据。Create a unified object model based on multiple object models, generate a unified OSLC service, call the unified OSLC service according to client instructions, and return the data to be queried by the client.
需要说明的是，上述实施例提供的多源异构数据的集成系统在执行多源异构数据的集成方法时，仅以上述各功能模块的划分进行举例说明，实际应用中，可以根据需要而将上述功能分配由不同的功能模块完成，即将设备的内部结构划分成不同的功能模块，以完成以上描述的全部或者部分功能。另外，上述实施例提供的多源异构数据的集成系统与多源异构数据的集成方法实施例属于同一构思，其体现实现过程详见系统实施例，这里不再赘述。It should be noted that, when the multi-source heterogeneous data integration system provided by the above embodiments executes the multi-source heterogeneous data integration method, only the division of the above functional modules is used as an example for illustration. The above-mentioned function distribution is completed by different function modules, that is, the internal structure of the device is divided into different function modules, so as to complete all or part of the functions described above. In addition, the multi-source heterogeneous data integration system and the multi-source heterogeneous data integration method embodiments provided by the above embodiments belong to the same concept, and the embodiment and implementation process are detailed in the system embodiments, which will not be repeated here.
本申请实施例还提供一种与前述实施例所提供的多源异构数据的集成方法对应的计算机可读存储介质，请参考图10，其示出的计算机可读存储介质为光盘1000，其上存储有计算机程序(即程序产品)，计算机程序在被处理器运行时，会执行前述任意实施例所提供的多源异构数据的集成方法。Embodiments of the present application further provide a computer-readable storage medium corresponding to the method for integrating multi-source heterogeneous data provided by the foregoing embodiments, please refer to FIG. 10 , the computer-readable storage medium shown is an
需要说明的是，计算机可读存储介质的例子还可以包括，但不限于相变内存(PRAM)、静态随机存取存储器(SRAM)、动态随机存取存储器(DRAM)、其他类型的随机存取存储器(RAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、快闪记忆体或其他光学、磁性存储介质，在此不再一一赘述。It should be noted that examples of computer-readable storage media may also include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory Memory (RAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Flash Memory or other optical and magnetic storage media will not be repeated here.
本申请的上述实施例提供的计算机可读存储介质与本申请实施例提供的多源异构数据的集成方法出于相同的发明构思，具有与其存储的应用程序所采用、运行或实现的方法相同的有益效果。The computer-readable storage medium provided by the above-mentioned embodiments of the present application and the method for integrating multi-source heterogeneous data provided by the embodiments of the present application are based on the same inventive concept, and have the same methods adopted, executed or implemented by the application programs stored in them. beneficial effect.
以上实施例的各技术特征可以进行任意的组合，为使描述简洁，未对上述实施例中的各个技术特征所有可能的组合都进行描述，然而，只要这些技术特征的组合不存在矛盾，都应当认为是本说明书记载的范围。The technical features of the above embodiments can be combined arbitrarily. In order to make the description simple, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction in the combination of these technical features It is considered to be the range described in this specification.
以上实施例仅表达了本发明的几种实施方式，其描述较为具体和详细，但并不能因此而理解为对本发明专利范围的限制。应当指出的是，对于本领域的普通技术人员来说，在不脱离本发明构思的前提下，还可以做出若干变形和改进，这些都属于本发明的保护范围。因此，本发明专利的保护范围应以所附权利要求为准。The above embodiments only represent several embodiments of the present invention, and the descriptions thereof are specific and detailed, but should not be construed as a limitation on the scope of the patent of the present invention. It should be pointed out that for those of ordinary skill in the art, without departing from the concept of the present invention, several modifications and improvements can also be made, which all belong to the protection scope of the present invention. Therefore, the protection scope of the patent of the present invention should be subject to the appended claims.
Claims (10)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210073227.3ACN114564475A (en) | 2022-01-21 | 2022-01-21 | Integration method, system and storage medium of multi-source heterogeneous data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210073227.3ACN114564475A (en) | 2022-01-21 | 2022-01-21 | Integration method, system and storage medium of multi-source heterogeneous data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114564475Atrue CN114564475A (en) | 2022-05-31 |
Family
ID=81714661
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210073227.3APendingCN114564475A (en) | 2022-01-21 | 2022-01-21 | Integration method, system and storage medium of multi-source heterogeneous data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114564475A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116149650A (en)* | 2022-11-11 | 2023-05-23 | 北京字跳网络技术有限公司 | Configuration method of data integration strategy, data integration method, device, equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102737086A (en)* | 2012-01-13 | 2012-10-17 | 冶金自动化研究设计院 | Iron and steel enterprise information integration platform based on CIM model |
| US20130132372A1 (en)* | 2011-11-17 | 2013-05-23 | Benefitfocus.Com | Systems and methods for dynamic service integration |
| CN104504094A (en)* | 2014-12-26 | 2015-04-08 | 中国石油集团工程设计有限责任公司北京分公司 | Various data source integrated management method for oil and gas field |
| EP3021266A1 (en)* | 2014-11-14 | 2016-05-18 | The Boeing Company | Lean product modeling systems and methods |
| CN111209319A (en)* | 2018-11-21 | 2020-05-29 | 华为技术有限公司 | Data service method and device |
| CN113722289A (en)* | 2021-08-09 | 2021-11-30 | 杭萧钢构股份有限公司 | Method, device, electronic equipment and medium for constructing data service |
- 2022
- 2022-01-21CNCN202210073227.3Apatent/CN114564475A/enactivePending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130132372A1 (en)* | 2011-11-17 | 2013-05-23 | Benefitfocus.Com | Systems and methods for dynamic service integration |
| CN102737086A (en)* | 2012-01-13 | 2012-10-17 | 冶金自动化研究设计院 | Iron and steel enterprise information integration platform based on CIM model |
| EP3021266A1 (en)* | 2014-11-14 | 2016-05-18 | The Boeing Company | Lean product modeling systems and methods |
| CN104504094A (en)* | 2014-12-26 | 2015-04-08 | 中国石油集团工程设计有限责任公司北京分公司 | Various data source integrated management method for oil and gas field |
| CN111209319A (en)* | 2018-11-21 | 2020-05-29 | 华为技术有限公司 | Data service method and device |
| CN113722289A (en)* | 2021-08-09 | 2021-11-30 | 杭萧钢构股份有限公司 | Method, device, electronic equipment and medium for constructing data service |
Non-Patent Citations (1)
| Title |
|---|
| 赵辉 等: "基于工厂模式的OSLC数据集成接口设计与实现", 《空间控制技术与应用》, vol. 47, no. 2, 30 April 2021 (2021-04-30), pages 73 - 79* |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116149650A (en)* | 2022-11-11 | 2023-05-23 | 北京字跳网络技术有限公司 | Configuration method of data integration strategy, data integration method, device, equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| AU2017202952B2 (en) | System for linking diverse data systems | |
| CN111061733B (en) | Data processing method, device, electronic equipment and computer readable storage medium | |
| CN112180776B (en) | OPC UA information modeling method and device based on equipment component module | |
| CN111159191A (en) | Data processing method, device and interface | |
| CN107526806A (en) | The conversion method and device of data | |
| WO2016141685A1 (en) | Telecommunications engineering drawing generation method and drawing design client | |
| CN105930947B (en) | Method and system for controlling manufacturing processes in discrete production lines | |
| CN103514294B (en) | data monitoring method and system | |
| CN111797125A (en) | Report creating method and device, electronic equipment and computer readable storage medium | |
| CN114398151A (en) | A configuration management method, apparatus, device and storage medium | |
| CN114691723A (en) | Industrial data processing method, apparatus, equipment and medium | |
| CN110347375A (en) | The virtual synthetic natural environment framework of combination of resources formula and method for virtual test | |
| CN114564475A (en) | Integration method, system and storage medium of multi-source heterogeneous data | |
| CN114741358A (en) | Part parameter detection method, device, computer equipment and storage medium | |
| CN112540970B (en) | Metadata blood margin analysis method and system based on version management | |
| CN118709092A (en) | Multi-dimensional classification method, device and storage medium | |
| CN115374109B (en) | Data access method, apparatus, computing device and system | |
| CN109446263A (en) | A kind of data relationship correlating method and device | |
| CN114970485A (en) | Industrial data processing method, device, electronic device and storage medium | |
| CN102289504B (en) | Network-based monitoring information general inquiry software system and design method | |
| CN119960979B (en) | Product digital passport generation method, device, electronic device and computer-readable medium | |
| CN109684617A (en) | A kind of report generation method and device | |
| CN113282276B (en) | Model mapping method and device | |
| CN116629718B (en) | An industrial data traceback method, device, electronic equipment and storage medium | |
| Korff et al. | Is OSLC Ready for Industrial Applications in Systems Engineering? A Case Study in Automotive |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |