技术领域technical field
本发明涉及数据处理技术领域，具体而言，涉及一种报表开发系统、报表开发方法、存储介质和电子设备。The invention relates to the technical field of data processing, in particular to a report development system, a report development method, a storage medium and electronic equipment.
背景技术Background technique
在大数据时代，运营分析对一个企业的发展起着至关重要的作用。尤其在医疗行业中，医疗机构日常运营数据的分析处理结果，对管理者的决策起到巨大的支持作用，并且可以有效提高稀缺医疗资源的利用率。In the era of big data, operational analysis plays a vital role in the development of an enterprise. Especially in the medical industry, the analysis and processing results of the daily operation data of medical institutions can greatly support the decision-making of managers, and can effectively improve the utilization rate of scarce medical resources.
随着对医疗卫生事业越来越重视，医疗行业已呈现迅猛发展的态势，医院内部特别是三级医院中的医疗系统多达几十，甚至上百个，这些系统每天都会产生大量的业务数据。业务数据的特点是类型复杂多样，产生频次较高，数据量大，而且会有很多冗余数据。随着互联网技术的发展，这些数据越来越区趋于高度集中化，大规模数据中心逐步成立，对海量数据的存储、处理以及展示的专业系统的需求日益迫切。With more and more emphasis on medical and health care, the medical industry has shown a trend of rapid development. There are dozens or even hundreds of medical systems in hospitals, especially in tertiary hospitals. These systems generate a large amount of business data every day. . Business data is characterized by complex and diverse types, high frequency of generation, large amount of data, and a lot of redundant data. With the development of Internet technology, these data are becoming more and more highly centralized, large-scale data centers are gradually established, and the demand for professional systems for storing, processing and displaying massive data is becoming increasingly urgent.
另外，医疗机构内部各业务部门可能会提出各种各样的报表需求，后台技术服务部门虽然已尽力处理这些需求，然而，仍不能较好地快速应对业务部门的需求。因此，亟待需要一种快速高效满足业务发展的专业医疗大数据分析系统。In addition, various business departments within the medical institution may have various report requirements. Although the background technical service department has tried its best to deal with these requirements, it still cannot quickly respond to the needs of the business departments. Therefore, there is an urgent need for a professional medical big data analysis system that can quickly and efficiently meet business development.
鉴于此，需要一种报表开发系统、报表开发方法、存储介质和电子设备。In view of this, a report development system, a report development method, a storage medium and an electronic device are required.
需要说明的是，在上述背景技术部分公开的信息仅用于加强对本发明的背景的理解，因此可以包括不构成对本领域普通技术人员已知的现有技术的信息。It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present invention, and therefore may include information that does not constitute prior art known to those of ordinary skill in the art.
发明内容Contents of the invention
本发明的目的在于提供一种报表开发系统、报表开发方法、存储介质和电子设备，进而至少在一定程度上克服由于相关技术的限制和缺陷而导致的一个或者多个问题。The purpose of the present invention is to provide a report development system, a report development method, a storage medium and an electronic device, so as to overcome one or more problems caused by limitations and defects of related technologies at least to a certain extent.
根据本发明的一个方面，提供一种报表开发系统，包括：According to one aspect of the present invention, a report development system is provided, including:
基础数据仓库，用于对各源系统的数据进行整合并存储整合后的数据；The basic data warehouse is used to integrate the data of various source systems and store the integrated data;
主题模块，用于基于基础数据仓库按业务主题对不同源系统的共性数据进行分类存储；The theme module is used to classify and store the common data of different source systems according to the business theme based on the basic data warehouse;
分析模块，用于针对主题模块存储的数据定义数据指标并维护到目标维度表中，并基于Spark架构进行数据查询和计算；The analysis module is used to define data indicators for the data stored in the theme module and maintain them in the target dimension table, and perform data query and calculation based on the Spark architecture;
报表开发模块，用于根据用户提供的报表需求并结合主题模块和分析模块进行报表开发。The report development module is used to develop reports according to the report requirements provided by users and in combination with theme modules and analysis modules.
可选地，报表开发模块包括：Optionally, the report development module includes:
需求获取单元，用于获取用户的报表需求；A requirement acquiring unit, configured to acquire the report requirement of the user;
数据类型判断单元，用于根据报表需求确定报表数据类型；A data type judging unit, configured to determine the report data type according to report requirements;
共性报表开发单元，用于在数据类型判断单元判断出报表数据类型为共性数据时，将报表数据对应的数据指标整合到用户自助开发平台上以供用户自行开发报表；The common report development unit is used to integrate the data indicators corresponding to the report data into the user self-development platform for the user to develop the report by himself when the data type judging unit judges that the report data type is common data;
个性报表开发单元，用于在数据类型判断单元判断出报表数据类型为个性数据时，将报表需求同步部署到开发终端和用户终端以供开发人员和用户结合主题模块和分析模块协同开发报表。The personalized report development unit is used to synchronously deploy the report requirements to the development terminal and the user terminal when the data type judging unit determines that the report data type is personalized data, so that developers and users can jointly develop reports in combination with the theme module and the analysis module.
可选地报表开发模块还包括：Optional report development module also includes:
数据类型转换单元，用于当个性数据的出现频率大于一阈值时，将个性数据转换为共性数据。The data type conversion unit is used to convert the individual data into common data when the frequency of occurrence of the individual data is greater than a threshold.
可选地，分析模块包括：Optionally, analysis modules include:
Spark计算单元，用于接收查询语句并对查询语句进行分析以生成一组RDD，判断查询语句中是否存在顺序指令，如果不存在顺序指令，则并行执行各RDD对应的任务并输出执行结果；如果存在顺序指令，则基于各RDD对应的任务的索引顺序执行各RDD对应的任务，并按索引顺序输出执行结果。The Spark calculation unit is used to receive query statements and analyze the query statements to generate a set of RDDs, and determine whether there are sequential instructions in the query statements. If there are no sequential instructions, execute the tasks corresponding to each RDD in parallel and output the execution results; if If there is a sequence instruction, the tasks corresponding to each RDD are executed based on the index order of the task corresponding to each RDD, and the execution results are output in the order of the index.
根据本发明的一个方面，提供一种报表开发方法，包括：According to one aspect of the present invention, a report development method is provided, including:
通过基础数据仓库对各源系统的数据进行整合并存储整合后的数据；Integrate the data of each source system through the basic data warehouse and store the integrated data;
基于基础数据仓库按业务主题对不同源系统的共性数据进行分类存储；Classify and store the common data of different source systems according to the business theme based on the basic data warehouse;
定义按业务主题进行分类存储的数据的数据指标并维护到目标维度表中，基于Spark架构进行数据查询和计算；Define the data indicators of the data classified and stored according to the business theme and maintain them in the target dimension table, and perform data query and calculation based on the Spark architecture;
根据用户提供的报表需求并结合按业务主题分类存储的数据和Spark架构进行报表开发。According to the report requirements provided by users and combined with the data stored according to the business theme and the Spark architecture, the report development is carried out.
可选地，根据用户提供的报表需求并结合按业务主题分类存储的数据和Spark架构进行报表开发包括：Optionally, report development based on the report requirements provided by users combined with data stored by business theme and Spark architecture includes:
获取用户的报表需求；Obtain the user's report requirements;
根据报表需求确定报表数据类型；Determine the report data type according to the report requirements;
在报表数据类型为共性数据时，将报表数据对应的数据指标整合到用户自助开发平台上以供用户自行开发报表；When the report data type is common data, integrate the data indicators corresponding to the report data into the user self-service development platform for users to develop reports by themselves;
在报表数据类型为个性数据时，将报表需求同步部署到开发终端和用户终端，以供开发人员和用户利用按业务主题分类存储的数据和Spark架构协同开发报表。When the report data type is individual data, the report requirements are deployed to the development terminal and user terminal synchronously, so that developers and users can use the data stored according to the business theme and the Spark architecture to jointly develop reports.
可选地，报表开发方法还包括：Optionally, the report development method further includes:
当个性数据的出现频率大于一阈值时，将个性数据转换为共性数据。When the frequency of occurrence of the individual data is greater than a threshold, the individual data is converted into common data.
可选地，基于Spark架构进行数据查询和计算包括：Optionally, data query and calculation based on the Spark architecture includes:
接收查询语句并对查询语句进行分析以生成一组RDD；Receive the query statement and analyze the query statement to generate a set of RDD;
判断查询语句中是否存在顺序指令；Determine whether there are sequential instructions in the query statement;
如果不存在顺序指令，则并行执行各RDD对应的任务并输出执行结果；If there is no sequential instruction, execute the tasks corresponding to each RDD in parallel and output the execution result;
如果存在顺序指令，则基于各RDD对应的任务的索引顺序执行各RDD对应的任务，并按索引顺序输出执行结果。If there is a sequence instruction, execute the tasks corresponding to each RDD based on the index order of the tasks corresponding to each RDD, and output the execution results in the index order.
根据本发明的一个方面，提供一种存储介质，其上存储有计算机程序，计算机程序被处理器执行时实现上述任意一项的报表开发方法。According to one aspect of the present invention, a storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, any one of the report development methods described above is implemented.
根据本发明的一个方面，提供一种电子设备，包括：According to one aspect of the present invention, an electronic device is provided, comprising:
处理器；以及processor; and
存储器，用于存储处理器的可执行指令；memory for storing executable instructions of the processor;
其中，处理器配置为经由执行可执行指令来执行上述任意一项的报表开发方法。Wherein, the processor is configured to execute any one of the report development methods described above by executing executable instructions.
在本发明的一些实施例所提供的技术方案中，一方面，通过基础数据仓库对数据进行整合存储，避免了数据冲突和冗余，可以提高数据存取速度；另一方面，通过主题模块将数据按业务主题进行分类存储，可以避免频繁的需求变更对系统架构的影响，确保了数据逻辑的稳定性；再一方面，在分析模块中，对数据定义数据指标，规范了数据标准，可以确保数据的一致性，另外，通过Spark架构进行数据查询和计算，大大提高了数据查询和计算的响应速度；又一方面，在报表开发模块中，可以根据用户的报表需求进行报表开发，增加了开发过程的灵活性并节省了开发资源。In the technical solutions provided by some embodiments of the present invention, on the one hand, data is integrated and stored through the basic data warehouse, which avoids data conflicts and redundancy, and can improve data access speed; on the other hand, through the subject module, the Data is classified and stored according to business themes, which can avoid the impact of frequent demand changes on the system architecture and ensure the stability of data logic; on the other hand, in the analysis module, data indicators are defined for data and data standards are standardized, which can ensure Data consistency. In addition, data query and calculation are performed through the Spark architecture, which greatly improves the response speed of data query and calculation. On the other hand, in the report development module, report development can be carried out according to user report requirements, increasing the development process flexibility and saves development resources.
应当理解的是，以上的一般描述和后文的细节描述仅是示例性和解释性的，并不能限制本公开。It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure.
附图说明Description of drawings
此处的附图被并入说明书中并构成本说明书的一部分，示出了符合本发明的实施例，并与说明书一起用于解释本发明的原理。显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。在附图中：The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description serve to explain the principles of the invention. Apparently, the drawings in the following description are only some embodiments of the present invention, and those skilled in the art can obtain other drawings according to these drawings without creative efforts. In the attached picture:
图1示出了目前一些技术的数据仓库的架构示意图；Figure 1 shows a schematic diagram of the architecture of data warehouses of some current technologies;
图2示意性示出了根据本发明的示例性实施方式的报表开发系统的方框图；Fig. 2 schematically shows a block diagram of a report development system according to an exemplary embodiment of the present invention;
图3示意性示出了根据本发明的示例性实施方式的分析模块的方框图；Fig. 3 schematically shows a block diagram of an analysis module according to an exemplary embodiment of the present invention;
图4示意性示出了根据本发明的示例性实施方式的报表开发模块的方框图；Fig. 4 schematically shows a block diagram of a report development module according to an exemplary embodiment of the present invention;
图5示意性示出了根据本发明的示例性实施方式的另一报表开发模块的方框图；Fig. 5 schematically shows a block diagram of another report development module according to an exemplary embodiment of the present invention;
图6示意性示出了根据本发明的示例性实施方式的报表开发方法的流程图；FIG. 6 schematically shows a flow chart of a report development method according to an exemplary embodiment of the present invention;
图7示意性示出了根据本发明的示例性实施方式的基于Spark构架进行数据查询和计算的流程图；Fig. 7 schematically shows a flow chart of data query and calculation based on the Spark framework according to an exemplary embodiment of the present invention;
图8示意性示出了根据本发明的示例性实施方式的报表开发过程的流程图；FIG. 8 schematically shows a flow chart of a report development process according to an exemplary embodiment of the present invention;
图9示意性示出了根据本发明的示例性实施方式的报表开发架构的一实施例的方框图；Fig. 9 schematically shows a block diagram of an embodiment of a report development architecture according to an exemplary embodiment of the present invention;
图10示出了根据本发明的示例性实施方式的存储介质的示意图；以及Figure 10 shows a schematic diagram of a storage medium according to an exemplary embodiment of the present invention; and
图11示意性示出了根据本发明的示例性实施方式的电子设备的方框图。Fig. 11 schematically shows a block diagram of an electronic device according to an exemplary embodiment of the present invention.
具体实施方式Detailed ways
现在将参考附图更全面地描述示例实施方式。然而，示例实施方式能够以多种形式实施，且不应被理解为限于在此阐述的范例；相反，提供这些实施方式使得本公开将更加全面和完整，并将示例实施方式的构思全面地传达给本领域的技术人员。所描述的特征、结构或特性可以以任何合适的方式结合在一个或更多实施方式中。在下面的描述中，提供许多具体细节从而给出对本发明的实施方式的充分理解。然而，本领域技术人员将意识到，可以实践本发明的技术方案而省略所述特定细节中的一个或更多，或者可以采用其它的方法、组元、装置、步骤等。在其它情况下，不详细示出或描述公知技术方案以避免喧宾夺主而使得本公开的各方面变得模糊。Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided in order to give a thorough understanding of embodiments of the invention. However, those skilled in the art will appreciate that the technical solution of the present invention may be practiced without one or more of the specific details, or other methods, components, devices, steps, etc. may be adopted. In other instances, well-known technical solutions have not been shown or described in detail to avoid obscuring aspects of the present disclosure.
此外，附图仅为本公开的示意性图解，并非一定是按比例绘制。图中相同的附图标记表示相同或类似的部分，因而将省略对它们的重复描述。附图中所示的一些方框图是功能实体，不一定必须与物理或逻辑上独立的实体相对应。可以采用软件形式来实现这些功能实体，或在一个或多个硬件模块或集成电路中实现这些功能实体，或在不同网络和/或处理器装置和/或微控制器装置中实现这些功能实体。Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus repeated descriptions thereof will be omitted. Some of the block diagrams shown in the drawings are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in software, or in one or more hardware modules or integrated circuits, or in different network and/or processor means and/or microcontroller means.
附图中所示的流程图仅是示例性说明，不是必须包括所有的步骤。例如，有的步骤还可以分解，而有的步骤可以合并或部分合并，因此实际执行的顺序有可能根据实际情况改变。The flowcharts shown in the figures are illustrative only and do not necessarily include all steps. For example, some steps can be decomposed, and some steps can be combined or partly combined, so the actual execution sequence may be changed according to the actual situation.
下面将以医疗系统中的报表开发为例对本发明的内容进行描述，然而，应当理解的是，本发明公开的报表开发系统及方法还可以应用于其他领域的报表开发及数据查询分析的过程中，本示例性实施方式中对此不做特殊限定。The content of the present invention will be described below by taking report development in the medical system as an example. However, it should be understood that the report development system and method disclosed in the present invention can also be applied to the process of report development and data query analysis in other fields , which is not specifically limited in this exemplary embodiment.
在一些技术中，通常采用数据仓库技术对医疗数据进行存储分析。目前，数据仓库技术通常采用三层数据结构，具体的，三层数据结构可以包括业务源系统、数据仓库和应用集市。如图1所示，一方面，业务源系统可以包括但不限于业务源系统数据111、业务源系统数据112、业务源系统数据113和业务源系统数据114，这些源系统数据通常需要人工进行维护；另一方面，业务源系统中的数据可以由数据仓库120获取，数据仓库120可以将获取的数据进行统一整合，其可以是一个面向主题的、集成的、相对稳定的、反映历史变化的数据集合。通过数据仓库120，可以省去数据进行联合分析时需要前往不同源系统进行采集的过程；再一方面，数据仓库120可以将自身存储的数据发送至应用集市131、应用集市132和/或应用集市133以便具体应用这些数据。In some technologies, data warehouse technology is usually used to store and analyze medical data. At present, the data warehouse technology usually adopts a three-tier data structure. Specifically, the three-tier data structure may include a business source system, a data warehouse, and an application mart. As shown in Figure 1, on the one hand, the business source system may include but not limited to business source system data 111, business source system data 112, business source system data 113, and business source system data 114, and these source system data usually require manual maintenance On the other hand, the data in the business source system can be acquired by the data warehouse 120, and the data warehouse 120 can integrate the acquired data uniformly, which can be subject-oriented, integrated, relatively stable, and reflect historical changes gather. Through the data warehouse 120, the process of collecting data from different source systems for joint analysis can be omitted; on the other hand, the data warehouse 120 can send the data stored by itself to the application market 131, the application market 132 and/or The application market 133 is used to specifically apply these data.
目前，通常采用Hadoop(一种分布式系统构架)平台构建的HBase数据库来替代传统的事务型数据仓库。HBase数据库支持海量数据的存储分析且具有良好的扩展性，可以在HBase数据库基础上建立数据分析和展示模块，形成经营报表分析系统。然而，对医疗数据的集成、分析以及展示仍存在以下问题：一方面，数据仓库将业务数据直接暴露给经营报表系统进行数据分析，造成业务数据和展示数据耦合度较高，经营报表系统内部模块之间的数据依赖性较强，计算出的数据指标不能复用，降低了系统的交互效率；另一方面，在报表展示的过程中，用户往往期望在点开一张报表时能得到快速的的响应，尤其是在移动端，因此面对海量数据，计算效率是一个不容忽视的问题，但目前的经营报表系统缺少专门的处理计算模块，或者计算模块的效率较低；再一方面，医疗行业发展迅猛，企业运营情况多变，业务部门可能急于获取某类报表，而目前报表开发模式不能满足业务部门的需求，待技术部门将报表开发完成后，可能会错过业务部门最佳需求的时间点。At present, the HBase database built on the Hadoop (a distributed system architecture) platform is usually used to replace the traditional transactional data warehouse. The HBase database supports the storage and analysis of massive data and has good scalability. Data analysis and display modules can be established on the basis of the HBase database to form a business report analysis system. However, the following problems still exist in the integration, analysis and display of medical data: on the one hand, the data warehouse directly exposes business data to the business report system for data analysis, resulting in a high degree of coupling between business data and display data, and the internal modules of the business report system The data dependencies among them are strong, and the calculated data indicators cannot be reused, which reduces the interaction efficiency of the system; on the other hand, in the process of report display, users often expect to get quick response, especially on the mobile side, so in the face of massive data, computing efficiency is a problem that cannot be ignored, but the current business report system lacks a dedicated processing and computing module, or the efficiency of the computing module is low; on the other hand, medical The industry is developing rapidly, and the operation of the enterprise is changing. The business department may be eager to obtain certain types of reports. However, the current report development model cannot meet the needs of the business department. After the technical department completes the report development, it may miss the best time for the business department. point.
鉴于此，本发明提供了一种报表开发系统。In view of this, the present invention provides a report development system.
图2示意性示出了本发明的示例性实施方式的报表开发系统的方框图。参考图2，所述报表开发系统2可以包括基础数据仓库21、主题模块23、分析模块25和报表开发模块27。下面将对报表开发系统2中的各模块进行详细说明。Fig. 2 schematically shows a block diagram of a report development system according to an exemplary embodiment of the present invention. Referring to FIG. 2 , the report development system 2 may include a basic data warehouse 21 , a theme module 23 , an analysis module 25 and a report development module 27 . Each module in the report development system 2 will be described in detail below.
基础数据仓库21，可以用于对各源系统的数据进行整合并存储整合后的数据。The basic data warehouse 21 can be used to integrate the data of various source systems and store the integrated data.
各源系统中存储的是业务开展过程中的流程数据，以医疗系统为例，这些流程可以包括但不限于挂号、看诊、开处方、缴费、取药等。除HIS(Hospital Information System，医院信息系统)外，用户可能同时使用了体检系统和/或财务系统，这些系统之间可能存在数据编码重复、甚至冲突的问题。Each source system stores process data in the process of business development. Taking the medical system as an example, these processes may include but are not limited to registration, doctor consultation, prescription, payment, and medicine collection. In addition to HIS (Hospital Information System, hospital information system), users may use the physical examination system and/or financial system at the same time, and there may be data coding duplication or even conflicts between these systems.
在本发明的示例性实施方式中，基础数据仓库21可以根据一数据模型将各源系统的数据抽取出来，并按照第三范式建模规则组织数据，随后，根据数据特征进行过滤和整合。其中，数据模型可以是由开发人员自行设定的与实际业务数据相关的模型，并且所述数据特征与该数据模型对应。这样的处理解决了数据冲突的问题，此时存储的数据并未增加，仅存储形式发生了变化，无需额外占用存储空间。In an exemplary embodiment of the present invention, the basic data warehouse 21 can extract data from various source systems according to a data model, organize the data according to the third normal form modeling rules, and then perform filtering and integration according to data characteristics. Wherein, the data model may be a model related to actual business data set by the developer, and the data features correspond to the data model. Such processing solves the problem of data conflicts. At this time, the stored data does not increase, only the storage form changes, and no additional storage space is required.
本发明的基础数据仓库21可以基于Hadoop平台而构建，可以通过HBase数据库存储经历数据模型整合后的数据。另外，本发明还可以集成MongoDB数据库。具体的，针对业务型数据特点，提前制定相应的数据过滤准则，提高数据的质量，并将源系统数据进行转换，存储到HBase数据库中；针对非关系型的数据，也可以存储到MongoDB数据库，不需要提前创建数据结构，可以支持丰富的查询，同时可创建索引，对应生成一个高效的查询计划。The basic data warehouse 21 of the present invention can be constructed based on the Hadoop platform, and the data after data model integration can be stored through the HBase database. In addition, the present invention can also integrate MongoDB database. Specifically, according to the characteristics of business data, formulate corresponding data filtering criteria in advance to improve the quality of data, and convert the source system data and store it in the HBase database; for non-relational data, it can also be stored in the MongoDB database. It does not need to create data structures in advance, and can support rich queries. At the same time, indexes can be created to generate an efficient query plan.
通过基础数据仓库对数据进行整合存储，避免了数据冲突和冗余，可以提高数据存取速度。The data is integrated and stored through the basic data warehouse, avoiding data conflict and redundancy, and improving the speed of data access.
主题模块23，可以用于基于基础数据仓库21按业务主题对不同源系统的共性数据进行分类存储。The theme module 23 can be used to classify and store the common data of different source systems by business theme based on the basic data warehouse 21 .
针对医疗系统，业务主题可以包括但不限于客户主题、绩效主题、运行主题、大病预测主题、公共主题等。主题模块23可以基于基础数据仓库21将不同源系统的共性数据抽取出来，将同一数据源中属于同一分析主题的表或表中某些字段组合在一起，为进一步的可视化操作提供基本元素。将业务数据通过业务主题进行存储，而非通过应用或应用需求进行组织存储，这样的益处在于保证数据逻辑的稳定性，即使频繁或颠覆性的需求更变也不会影响系统架构。For the medical system, business topics may include but not limited to customer topics, performance topics, operation topics, critical illness prediction topics, public topics, etc. The theme module 23 can extract the common data of different source systems based on the basic data warehouse 21, and combine tables or some fields in the tables belonging to the same analysis theme in the same data source to provide basic elements for further visualization operations. The benefit of storing business data by business topics rather than by applications or application requirements is to ensure the stability of data logic, even if frequent or subversive changes in requirements will not affect the system architecture.
应当理解的是，基础数据仓库21与主题模块23在数据存储上的区别在于：一方面，基础数据仓库21负责将各个业务源系统的数据进行有效分类存储，主题模块23在基础数据仓库21基础上，将不同源系统的共性数据进行整合，建立标准，解决数据重复加工、数据孤岛的问题；另一方面，基础数据仓库21将源系统数据对应创建数据库存储，而主题模块23需要根据业务需求文档或系统架构设计等，通过完整的系统体系，集中创建不同的主题，并进行同步加工和部署；再一方面，基础数据仓库21和主题模块23在物理存储上是相对隔离的，基础数据仓库21存储的是各个源系统完整数据，而主题模块23存放的是在业务发展过程中衍生出来的共性数据，两者独立存储，避免数据冗余，提供数据访问速度。It should be understood that the difference between the basic data warehouse 21 and the theme module 23 in terms of data storage is: on the one hand, the basic data warehouse 21 is responsible for effectively classifying and storing the data of each business source system, and the theme module 23 is based on the basic data warehouse 21. On the other hand, the basic data warehouse 21 creates a database to store the source system data correspondingly, and the theme module 23 needs to be based on business needs. Document or system architecture design, etc., through a complete system system, create different themes in a centralized manner, and perform synchronous processing and deployment; on the other hand, the basic data warehouse 21 and the theme module 23 are relatively isolated in physical storage, and the basic data warehouse 21 stores the complete data of each source system, while the theme module 23 stores the common data derived from the business development process. The two are stored independently to avoid data redundancy and provide data access speed.
此外，主题模块23可以包括但不限于业务对象、业务属性、过滤器和业务主题表关系等。其中，业务对象是构成业务主题的基本元素，业务对象可以嵌套业务对象，除第一级业务对象外，其余业务对象均可以新建业务子对象；业务属性是业务对象的基本组成元素，相当于表中的字段，可以在业务主题设备区进行业务属性的新建、编辑和删除；过滤器为业务属性表达式，其可以是四则运算或SQL表达式；针对业务主题表关系，根据系统选项有全局关系和局部表关系，通过表关系设置，形成最终具有逻辑关系的主题集市。In addition, the subject module 23 may include, but not limited to, business objects, business attributes, filters, and business subject table relations. Among them, the business object is the basic element that constitutes the business theme, and the business object can be nested with business objects. Except for the first-level business object, other business objects can create new business sub-objects; the business attribute is the basic component element of the business object, which is equivalent to The fields in the table can be used to create, edit and delete business attributes in the business theme device area; the filter is a business attribute expression, which can be four arithmetic operations or SQL expressions; for the business theme table relationship, according to the system options, there are global Relationships and partial table relationships, through table relationship settings, form a theme bazaar with logical relationships.
分析模块25，可以用于针对主题模块存储的数据定义数据指标并维护到目标维度表中，并基于Spark架构进行数据查询和计算。The analysis module 25 can be used to define data indicators for the data stored in the theme module and maintain them in the target dimension table, and perform data query and calculation based on the Spark architecture.
医疗领域数据类型繁多，数据名称专业性较强，存在许多数据含义较接近的情况，为了保证管理者、决策者与一线业务人员提及到的是同一问题，需要建立数据标准，统一数据规范。There are many types of data in the medical field, the data names are highly specialized, and there are many cases where the meaning of the data is relatively close. In order to ensure that managers, decision makers and front-line business personnel refer to the same problem, it is necessary to establish data standards and unify data specifications.
分析模块25可以建立指标定义。具体的，可以对主题模块23中存储的数据定义数据指标，仍以医疗系统为例，数据指标可以包括但不限于指标名称、指标等级、计算频率、表达式和计量单元等。随后，可以将这些数据指标维护到一目标维度表中，该目标维度表可以位于分析模块25的存储空间中，也可以位于其他存储空间，本示例性实施方式中对此不做特殊限定。另外，还可以对该目标维度表进行权限控制，也就是说，仅具有相应权限的人员才能对该目标维度表进行管理。The analysis module 25 may establish indicator definitions. Specifically, data indicators can be defined for the data stored in the subject module 23. Still taking the medical system as an example, the data indicators can include but not limited to indicator name, indicator level, calculation frequency, expression, and measurement unit. Subsequently, these data indicators can be maintained in a target dimension table, and the target dimension table can be located in the storage space of the analysis module 25 or in other storage spaces, which is not specifically limited in this exemplary embodiment. In addition, authority control can also be performed on the target dimension table, that is, only personnel with corresponding authority can manage the target dimension table.
通过对数据定义数据指标，并将数据指标维护到目标维度表中，规范了数据标准，可以确保数据的一致性。By defining data indicators for the data and maintaining the data indicators in the target dimension table, the data standards are standardized and data consistency can be ensured.
此外，Hadoop提供的MapReduce计算框架可以分析海量数据，但是这种处理方式仍存在响应速度较慢，不能较好地满足当前用户需求的问题。鉴于此，参考图3，本发明的分析模块25还可以包括Spark计算单元301。In addition, the MapReduce computing framework provided by Hadoop can analyze massive data, but this processing method still has the problem of slow response speed and cannot better meet the needs of current users. In view of this, referring to FIG. 3 , the analysis module 25 of the present invention may further include a Spark computing unit 301 .
具体的，Spark计算单元301可以用于接收查询语句并对查询语句进行分析以生成一组RDD(Resilient Distributed Dataset，弹性分布式数据集)，判断查询语句中是否存在顺序指令，如果不存在顺序指令，则并行执行各RDD对应的任务并输出执行结果；如果存在顺序指令，则基于各RDD对应的任务的索引顺序执行各RDD对应的任务，并按索引顺序输出执行结果。Specifically, the Spark calculation unit 301 can be used to receive a query statement and analyze the query statement to generate a set of RDD (Resilient Distributed Dataset, elastic distributed data set), and determine whether there is a sequence instruction in the query statement, if there is no sequence instruction , the tasks corresponding to each RDD are executed in parallel and the execution results are output; if there are sequential instructions, the tasks corresponding to each RDD are executed based on the index order of the tasks corresponding to each RDD, and the execution results are output according to the index order.
通过Spark架构进行数据查询和计算，大大提高了数据查询和计算的响应速度。Data query and calculation are performed through the Spark architecture, which greatly improves the response speed of data query and calculation.
报表开发模块27，可以用于根据用户提供的报表需求并结合主题模块23和分析模块25进行报表开发。The report development module 27 can be used to develop reports according to the report requirements provided by users and in combination with the theme module 23 and the analysis module 25 .
参考图4，报表开发模块27可以包括需求获取单元401、数据类型判断单元403、共性报表开发单元405和个性报表开发单元407，其中：Referring to Fig. 4, the report development module 27 may include a demand acquisition unit 401, a data type judgment unit 403, a common report development unit 405 and a personalized report development unit 407, wherein:
需求获取单元401，可以用于获取用户的报表需求；A requirement acquiring unit 401, which can be used to acquire the user's report requirement;
数据类型判断单元403，可以用于根据报表需求确定报表数据类型；The data type judging unit 403 can be used to determine the report data type according to the report requirements;
共性报表开发单元405，可以用于在数据类型判断单元判断出报表数据类型为共性数据时，将报表数据对应的数据指标整合到用户自助开发平台上以供用户自行开发报表；The common report development unit 405 can be used to integrate the data indicators corresponding to the report data into the user self-help development platform for the user to develop the report by himself when the data type judging unit determines that the report data type is common data;
个性报表开发单元407，可以用于在数据类型判断单元判断出报表数据类型为个性数据时，将报表需求同步部署到开发终端和用户终端以供开发人员和用户结合主题模块和分析模块协同开发报表。The personalized report development unit 407 can be used to synchronously deploy the report requirements to the development terminal and the user terminal when the data type judging unit judges that the report data type is personalized data, so that the developers and users can cooperate to develop the report in combination with the theme module and the analysis module .
针对共性报表开发单元405，由于主题模块23已对共性数据进行归类存储，分析模块25建立了对应的指标定义并通过Spark模块对其进行计算，因此，用户只需在开发人员开发的自助平台上通过简单的数据筛选，即可快速开发出自己需要的报表。另外，针对用户的具体使用过程，在语义模型的基础上，可以进行数据的灵活自助查询，并可以使用切片、钻取、交叉、折叠、预警、排序等对数据进行分析，不需要用户有报表开发的专业技术，只要了解业务需求，即可完成报表开发。For the common report development unit 405, since the theme module 23 has classified and stored the common data, the analysis module 25 has established the corresponding index definition and calculated it through the Spark module. Therefore, users only need to use the self-service platform developed by developers Through simple data filtering on the Internet, you can quickly develop the reports you need. In addition, according to the user's specific use process, on the basis of the semantic model, flexible self-service query of data can be performed, and data can be analyzed by slicing, drilling, crossing, folding, early warning, sorting, etc., without the need for users to have reports Developed professional technology, as long as you understand the business needs, you can complete the report development.
具体的过程可以包括：首先，可以进行数据源连接和设置，主要包括数据源连接、添加表、语义层定义、表关系视图；随后，可以创建业务主题；接下来，可以创建组合分析和透视分析，仅需在界面上选择自己需要的业务数据和分析方式，即可创建组合分析，并且在组合分析基础上，选择上钻、下钻、切片等多维分析操作，形成透视分析；然后，可以发布浏览，报表创建完成后，在资源发布里可以通过选择电脑主题、平板主题、手机主题等方式，发布到不同的浏览终端，并且在发布的同时，还可以进行资源授权，针对不同用户分配不同权限，进而提高数据的安全性。The specific process may include: first, data source connection and settings can be performed, mainly including data source connection, adding tables, semantic layer definition, and table relationship view; then, business topics can be created; next, combined analysis and perspective analysis can be created , you only need to select the business data and analysis method you need on the interface to create a combined analysis, and on the basis of the combined analysis, select multi-dimensional analysis operations such as drilling up, drilling down, and slicing to form a perspective analysis; then, you can publish Browse, after the report is created, you can publish it to different browsing terminals by selecting computer themes, tablet themes, mobile themes, etc. in the resource release, and at the same time of publishing, you can also perform resource authorization and assign different permissions to different users , thereby improving data security.
针对个性报表开发单元407，由开发人员开发，用户配合进行需求确认和测试验证，根据用户多样化的需求，开发人员在联合开发模块中可以进行地图分析、仪表分析、电子表格分析等，在基础数据仓库21的基础上，结合主题模块23和分析模块25，快速迭代开发完成用户的需求。For the personalized report development unit 407, it is developed by developers, and users cooperate to confirm requirements and test verification. According to the diverse needs of users, developers can perform map analysis, instrument analysis, spreadsheet analysis, etc. in the joint development module. Based on the data warehouse 21, combined with the theme module 23 and the analysis module 25, rapid iterative development completes the user's needs.
参考图5，相比于报表开发模块27，报表开发模块51除包括需求获取单元401、数据类型判断单元403、共性报表开发单元405和个性报表开发单元407外，还可以包括数据类型转换单元501，其中：Referring to FIG. 5 , compared to the report development module 27, the report development module 51 may include a data type conversion unit 501 in addition to a demand acquisition unit 401, a data type judgment unit 403, a common report development unit 405, and a personalized report development unit 407. ,in:
数据类型转换单元501，可以用于当个性数据的出现频率大于一阈值时，将所述个性数据转换为共性数据。其中，该阈值可以由开发人员根据实际业务情况自行设定，例如，该阈值可以为一天10次，也就是说，如果一个性数据在一天中出现10次，则可以将该个性数据转换为共性数据。由此，个性报表开发单元407可以切换至共性报表开发单元405，用户可以即可自行进行开发。The data type converting unit 501 may be configured to convert the individual data into common data when the frequency of occurrence of the individual data is greater than a threshold. Among them, the threshold can be set by the developer according to the actual business situation. For example, the threshold can be 10 times a day, that is, if a specific data appears 10 times in a day, the personal data can be converted into common data. Thus, the personalized report development unit 407 can be switched to the common report development unit 405, and the user can develop it by himself.
在本发明的示例性实施方式的报表开发系统中，一方面，通过基础数据仓库对数据进行整合存储，避免了数据冲突和冗余，可以提高数据存取速度；另一方面，通过主题模块将数据按业务主题进行分类存储，可以避免频繁的需求变更对系统架构的影响，确保了数据逻辑的稳定性；再一方面，在分析模块中，对数据定义数据指标，规范了数据标准，可以确保数据的一致性，另外，通过Spark架构进行数据查询和计算，大大提高了数据查询和计算的响应速度；又一方面，在报表开发模块中，可以根据用户的报表需求进行报表开发，可以增加开发过程的灵活性并节省了开发资源。In the report development system of the exemplary embodiment of the present invention, on the one hand, data is integrated and stored through the basic data warehouse, data conflict and redundancy are avoided, and data access speed can be improved; on the other hand, the subject module will Data is classified and stored according to business themes, which can avoid the impact of frequent demand changes on the system architecture and ensure the stability of data logic; on the other hand, in the analysis module, data indicators are defined for data and data standards are standardized, which can ensure Data consistency. In addition, data query and calculation are performed through the Spark architecture, which greatly improves the response speed of data query and calculation. On the other hand, in the report development module, report development can be carried out according to user report requirements, which can increase the development process flexibility and saves development resources.
进一步的，本示例实施方式中还提供了一种报表开发方法。Further, this example embodiment also provides a method for developing a report.
图6示意性示出了根据本发明的示例性实施方式的报表开发方法的流程图。参考图6，本发明的报表开发方法可以包括以下步骤：Fig. 6 schematically shows a flowchart of a report development method according to an exemplary embodiment of the present invention. Referring to Fig. 6, the report development method of the present invention may comprise the following steps:
S60.通过基础数据仓库对各源系统的数据进行整合并存储整合后的数据。S60. Integrate the data of each source system through the basic data warehouse and store the integrated data.
在本发明的示例性实施方式中，基础数据仓库可以根据一数据模型将各源系统的数据抽取出来，并按照第三范式建模规则组织数据。随后，根据与该数据模型对应的数据特征进行过滤和整合，并存储整合后的数据。另外，基础数据仓库可以基于Hadoop平台而构建，并且可以将整合后的数据存储至HBase数据库或MongoDB数据库。In an exemplary embodiment of the present invention, the basic data warehouse can extract data from various source systems according to a data model, and organize the data according to third normal form modeling rules. Then, filter and integrate according to the data characteristics corresponding to the data model, and store the integrated data. In addition, the basic data warehouse can be built based on the Hadoop platform, and the integrated data can be stored in the HBase database or MongoDB database.
通过基础数据仓库对数据进行整合存储，避免了数据冲突和冗余，可以提高数据存取速度。The data is integrated and stored through the basic data warehouse, avoiding data conflict and redundancy, and improving the speed of data access.
S62.基于基础数据仓库按业务主题对不同源系统的共性数据进行分类存储。S62. Based on the basic data warehouse, the common data of different source systems are classified and stored according to the business theme.
可以基于基础数据仓库将不同源系统的共性数据抽取出来，将同一数据源中属于同一分析主题的表或表中某些字段组合在一起，为进一步的可视化操作提供基本元素。将业务数据通过业务主题进行存储，而非通过应用或应用需求进行组织存储，这样的益处在于保证数据逻辑的稳定性，即使频繁或颠覆性的需求更变也不会影响系统架构。Based on the basic data warehouse, the common data of different source systems can be extracted, and the tables or some fields in the tables belonging to the same analysis subject in the same data source can be combined to provide basic elements for further visualization operations. The benefit of storing business data by business topics rather than by applications or application requirements is to ensure the stability of data logic, even if frequent or subversive changes in requirements will not affect the system architecture.
S64.定义按业务主题进行分类存储的数据的数据指标并维护到目标维度表中，并基于Spark架构进行数据查询和计算。S64. Define the data index of the data classified and stored according to the business theme and maintain it in the target dimension table, and perform data query and calculation based on the Spark architecture.
通过对数据定义数据指标，并将数据指标维护到目标维度表中，规范了数据标准，可以确保数据的一致性。By defining data indicators for the data and maintaining the data indicators in the target dimension table, the data standards are standardized and data consistency can be ensured.
此外，参考图7，对本发明的基于Spark架构进行数据查询和计算的过程进行示例性说明。In addition, with reference to FIG. 7 , the process of data query and calculation based on the Spark framework of the present invention is exemplarily described.
在步骤S701中，用户可以根据自身需求自定义SQL查询语句；在步骤S703中，可以将SQL查询语句输入Spark架构对应的模块；在步骤S705中，可以调用Spark应用程序的数据输入接口将该SQL查询语句发送给Spark应用程序；在步骤S707中，Spark可以对该SQL查询语句进行语法分析，生成一组RDD序列，并且生成这组RDD时会对应生成一个索引表，用于存储每个Job及其索引值，每个RDD对应一个Job，代表对数据的一次操作，所有Job完成后，才能完成一次完整的查询；在步骤S709中，生成Job，将Job提交给eventProcessActor(一事件处理执行器)，并且调用Spark的接口提交Job，每个Job对应一个Task。在步骤S711中，进行语法分析，判断提交Job的SOL查询语句是否有Order By(即上面提及的顺序指令)，如果有，则步骤跳转至步骤S713，如果没有，则步骤跳转至步骤S723；在步骤S713中，需要判断Task对应的索引值；在步骤S715中，根据确定出的索引值，如果索引值不同，则按索引值从小到大顺序执行，如果索引值相同，则各个Task并行执行；在步骤S717中，判断刚执行完Task对应索引值是否是输出结果索引值的下一位，如果是，则步骤跳转至步骤S727，如果不是，则步骤跳转至步骤S719；在步骤S719中，可以临时将索引值存放在内存中；在步骤S721中，如果输出索引值排到内存中的Task对应的索引值时，步骤跳转至步骤S727；在步骤S727中，直接输出到Spark的SQL输出模块；另外，在步骤S723中，各个Task可以并行执行；在步骤S725中，每个Task完成后，通知Spark的Context；在步骤S729中，可以将查询结果陆续反馈给用户；在步骤S731中，在所有Task输出完毕后，整个查询结束。In step S701, the user can customize the SQL query statement according to their own needs; in step S703, the SQL query statement can be input into the module corresponding to the Spark architecture; in step S705, the data input interface of the Spark application can be called The query statement is sent to the Spark application program; in step S707, Spark can perform grammatical analysis on the SQL query statement to generate a set of RDD sequences, and when generating this set of RDDs, an index table will be correspondingly generated for storing each Job and Its index value, each RDD corresponds to a Job, which represents an operation on the data, and a complete query can only be completed after all the Jobs are completed; in step S709, the Job is generated, and the Job is submitted to the eventProcessActor (an event processing executor) , and call the Spark interface to submit the Job, and each Job corresponds to a Task. In step S711, grammatical analysis is performed to determine whether the SOL query statement submitted to the Job has an Order By (ie, the order instruction mentioned above), if yes, then the step jumps to step S713, if not, then the step jumps to step S723; in step S713, it is necessary to determine the index value corresponding to the Task; in step S715, according to the determined index value, if the index value is different, then execute in ascending order of the index value, if the index value is the same, each Task Execution in parallel; in step S717, judge whether the corresponding index value of the task just executed is the next digit of the output result index value, if yes, then the step jumps to step S727, if not, then the step jumps to step S719; In step S719, the index value can be temporarily stored in the memory; in step S721, if the output index value is arranged to the index value corresponding to the Task in the memory, the step jumps to step S727; in step S727, directly output to The SQL output module of Spark; In addition, in step S723, each Task can execute in parallel; In step S725, after each Task is completed, notify the Context of Spark; In step S729, query results can be fed back to the user one after another; In step S731, after all Tasks are output, the entire query ends.
通过上述流程，可以大大提高查询的响应速度。另外，当用户自定义的SQL查询是简单无序的查询时，庞大的数据量可以分成多个Task并行执行，满足条件即可立即输出，如果是复杂的有序查询，也可以根据分解Job时生成的索引值表，按顺序输出，不需要等到所有Task都完成后才输出，既避免了数据溢出，又可以提高查询响应速度。Through the above process, the query response speed can be greatly improved. In addition, when the user-defined SQL query is a simple and unordered query, the huge amount of data can be divided into multiple Tasks for parallel execution, and the output can be output immediately if the conditions are satisfied. The generated index value table is output in order without waiting for all tasks to be completed, which not only avoids data overflow, but also improves query response speed.
S66.根据用户提供的报表需求并结合按业务主题分类存储的数据和Spark架构进行报表开发。S66. According to the report requirement provided by the user and combined with the data stored according to the business theme and the Spark framework, the report is developed.
具体的，首先，可以获取用户的报表需求；随后，可以根据报表需求确定报表数据类型；接下来，在判断出报表数据类型为共性数据时，可以将报表数据对应的数据指标整合到用户自助开发平台上以供用户自行开发报表，在判断出报表数据类型为个性数据时，可以将报表需求同步部署到开发终端和用户终端，以供开发人员和用户利用按业务主题分类存储的数据和Spark架构协同开发报表。Specifically, firstly, the user's report requirements can be obtained; then, the report data type can be determined according to the report requirements; next, when the report data type is determined to be common data, the data indicators corresponding to the report data can be integrated into the user self-development The platform is for users to develop reports by themselves. When the report data type is judged to be individual data, the report requirements can be deployed to the development terminal and user terminal synchronously, so that developers and users can use the data classified and stored according to business topics and the Spark architecture Collaboratively develop reports.
此外，当个性数据的出现频率大于一阈值时，可以将个性数据转换成共性数据。其中，该阈值可以是开发人员根据历史数据或经验自行设定的频率阈值，本示例性实施方式中对此不做特殊限定。In addition, when the frequency of occurrence of the individual data is greater than a threshold, the individual data can be converted into common data. Wherein, the threshold may be a frequency threshold set by the developer according to historical data or experience, which is not specifically limited in this exemplary embodiment.
参考图8对报表开发的过程进行说明。在步骤S801中，可以获取报表需求；在步骤S803中，可以判断报表数据类型，如果为个性数据，则步骤可以跳转至步骤S807，如果为共性数据，则步骤可以跳转至步骤S805；在步骤S805中，可以根据开发人员指定的目标维度表，通过简单筛选(操作上，可以通过拉拽的方式实现筛选)进行自助开发；在步骤S807中，用户可以配合开发人员协同开发、测试；在步骤S809中，可以进行对报表资源授权的过程；在步骤S811中，报表资源可以通过PC端和移动端同时发布。另外，当个性数据出现频率大于一阈值时，可以将该个性数据转换为共性数据。The process of report development will be described with reference to FIG. 8 . In step S801, the report requirement can be obtained; in step S803, the report data type can be judged, if it is individual data, the step can jump to step S807, if it is common data, the step can jump to step S805; In step S805, according to the target dimension table specified by the developer, self-service development can be carried out through simple screening (in operation, screening can be realized by dragging); in step S807, the user can cooperate with the developer to develop and test; In step S809, the process of authorizing the report resource can be carried out; in step S811, the report resource can be released simultaneously through the PC terminal and the mobile terminal. In addition, when the frequency of occurrence of individual data is greater than a threshold, the individual data can be converted into common data.
在本发明的示例性实施方式的报表开发方法中，一方面，通过基础数据仓库对数据进行整合存储，避免了数据冲突和冗余，可以提高数据存取速度；另一方面，将数据按业务主题进行分类存储，可以避免频繁的需求变更对系统架构的影响，确保了数据逻辑的稳定性；再一方面，对数据定义数据指标，规范了数据标准，可以确保数据的一致性，另外，通过Spark架构进行数据查询和计算，大大提高了数据查询和计算的响应速度；又一方面，可以根据用户的报表需求进行报表开发，增加了开发过程的灵活性并节省了开发资源。In the report development method of the exemplary embodiment of the present invention, on the one hand, data is integrated and stored through the basic data warehouse, data conflict and redundancy are avoided, and data access speed can be improved; on the other hand, data is stored according to business Classification and storage of topics can avoid the impact of frequent demand changes on the system architecture and ensure the stability of data logic; on the other hand, defining data indicators for data and standardizing data standards can ensure data consistency. In addition, through The Spark architecture performs data query and calculation, which greatly improves the response speed of data query and calculation; on the other hand, it can develop reports according to user report requirements, which increases the flexibility of the development process and saves development resources.
应当注意，尽管在附图中以特定顺序描述了本公开中方法的各个步骤，但是，这并非要求或者暗示必须按照该特定顺序来执行这些步骤，或是必须执行全部所示的步骤才能实现期望的结果。附加的或备选的，可以省略某些步骤，将多个步骤合并为一个步骤执行，以及/或者将一个步骤分解为多个步骤执行等。It should be noted that although the various steps of the methods of the present disclosure are depicted in the drawings in a particular order, this does not require or imply that the steps must be performed in that particular order, or that all illustrated steps must be performed to achieve the desired the result of. Additionally or alternatively, certain steps may be omitted, multiple steps may be combined into one step for execution, and/or one step may be decomposed into multiple steps for execution, etc.
图9示意性示出了根据本发明的示例性实施方式的报表开发架构的一实施例的方框图。该实施例以医疗系统为例，其中，该架构可以包括统一管理平台90、源系统91、企业数据仓库(EDW)92、开发平台93、应用平台94、终端95和用户96等。具体的，源系统91可以包括医疗系统中的HIS、EMR(Electronic Medical Record，电子病案记录)、LIS(LaboratoryInformation System，检验科信息系统)、PACS(Picture Archiving and CommunicationSystems,医学影像存档与通讯系统)等；企业数据仓库92可以包括技术接口层、标准数据层、主题模块和分析模块，其中，主题模块又可以包括数据整合层和公共汇总层，分析模块又可以包括业务逻辑单元和数据计算单元；开发平台93可以包括自助开发模块、联合开发模块、授权模块和发布模块；应用平台94可以包括企业报表、驾驶舱、经营分析等；终端95可以包括PC、手机及其他移动终端；用户96可以包括决策层、管理层和业务层，等等。Fig. 9 schematically shows a block diagram of an embodiment of a report development framework according to an exemplary embodiment of the present invention. This embodiment takes a medical system as an example, where the architecture may include a unified management platform 90, a source system 91, an enterprise data warehouse (EDW) 92, a development platform 93, an application platform 94, terminals 95, users 96, and the like. Specifically, the source system 91 may include HIS in the medical system, EMR (Electronic Medical Record, electronic medical record), LIS (Laboratory Information System, laboratory information system), PACS (Picture Archiving and Communication Systems, medical image archiving and communication system) etc.; the enterprise data warehouse 92 may include a technical interface layer, a standard data layer, a theme module and an analysis module, wherein the theme module may include a data integration layer and a common summary layer, and the analysis module may include a business logic unit and a data calculation unit; Development platform 93 may include self-service development module, joint development module, authorization module and release module; application platform 94 may include enterprise report, cockpit, business analysis, etc.; terminal 95 may include PC, mobile phone and other mobile terminals; user 96 may include Decision-making level, management level and business level, and so on.
根据本发明的一个实施例，针对一个二级康复医院，首先，可以将康复医院内部HIS、LIS、PACS、EMR、康复系统、长期护理服务系统等业务系统数据全部集成到数据仓库中，数据量可以达到TB级；接下来，在主题模块中根据业务范围和业务方需求在数据仓库之上建立了门诊、住院、体检、康复、长期护理等不同的主题子模块，在子模块基础上，梳理数据指标500余个，形成目标维度表，通过Spark工具进行数据处理及计算。在该实施例中，共计15个部门100余位业务人员在报表开发模块上开发了94张报表，技术人员开发了39张报表，开发的报表展示数据的维度较之前更丰富。另外，例如，之前开发一张报表需要花费需求人员、设计人员、开发人员共计4天时间，而采用本发明所述的报表开发系统仅需一天即可完成开发，不仅提高了企业员工的工作效率，而且较好地支撑了业务发展的需要，方便快捷地为企业管理层提供合理的决策支持。According to an embodiment of the present invention, for a secondary rehabilitation hospital, firstly, the business system data such as HIS, LIS, PACS, EMR, rehabilitation system, and long-term care service system inside the rehabilitation hospital can be integrated into the data warehouse. It can reach TB level; next, in the theme module, different theme sub-modules such as outpatient service, hospitalization, physical examination, rehabilitation, and long-term care are established on the data warehouse according to the business scope and needs of the business side. On the basis of the sub-modules, sort out More than 500 data indicators form a target dimension table, and data processing and calculation are performed through the Spark tool. In this embodiment, a total of more than 100 business personnel from 15 departments developed 94 reports on the report development module, and technical personnel developed 39 reports. The developed reports display more abundant data dimensions than before. In addition, for example, before developing a report, it took a total of 4 days for demanders, designers, and developers, but it only takes one day to complete the development by using the report development system described in the present invention, which not only improves the work efficiency of enterprise employees , and better support the needs of business development, conveniently and quickly provide reasonable decision-making support for the enterprise management.
在本发明的示例性实施例中，还提供了一种计算机可读存储介质，其上存储有能够实现本说明书上述方法的程序产品。在一些可能的实施方式中，本发明的各个方面还可以实现为一种程序产品的形式，其包括程序代码，当所述程序产品在终端设备上运行时，所述程序代码用于使所述终端设备执行本说明书上述“示例性方法”部分中描述的根据本发明各种示例性实施方式的步骤。In an exemplary embodiment of the present invention, a computer-readable storage medium is also provided, on which a program product capable of implementing the above-mentioned method in this specification is stored. In some possible implementations, various aspects of the present invention can also be implemented in the form of a program product, which includes program code, and when the program product is run on a terminal device, the program code is used to make the The terminal device executes the steps according to various exemplary embodiments of the present invention described in the "Exemplary Method" section above in this specification.
参考图10所示，描述了根据本发明的实施方式的用于实现上述方法的程序产品1000，其可以采用便携式紧凑盘只读存储器(CD-ROM)并包括程序代码，并可以在终端设备，例如个人电脑上运行。然而，本发明的程序产品不限于此，在本文件中，可读存储介质可以是任何包含或存储程序的有形介质，该程序可以被指令执行系统、装置或者器件使用或者与其结合使用。As shown in FIG. 10 , a program product 1000 for implementing the above method according to an embodiment of the present invention is described, which can adopt a portable compact disc read-only memory (CD-ROM) and include program codes, and can be used in terminal equipment, For example running on a personal computer. However, the program product of the present invention is not limited thereto. In this document, a readable storage medium may be any tangible medium containing or storing a program, and the program may be used by or in combination with an instruction execution system, apparatus or device.
所述程序产品可以采用一个或多个可读介质的任意组合。可读介质可以是可读信号介质或者可读存储介质。可读存储介质例如可以为但不限于电、磁、光、电磁、红外线、或半导体的系统、装置或器件，或者任意以上的组合。可读存储介质的更具体的例子(非穷举的列表)包括：具有一个或多个导线的电连接、便携式盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、光纤、便携式紧凑盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。The program product may reside on any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any combination thereof. More specific examples (non-exhaustive list) of readable storage media include: electrical connection with one or more conductors, portable disk, hard disk, random access memory (RAM), read only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.
计算机可读信号介质可以包括在基带中或者作为载波一部分传播的数据信号，其中承载了可读程序代码。这种传播的数据信号可以采用多种形式，包括但不限于电磁信号、光信号或上述的任意合适的组合。可读信号介质还可以是可读存储介质以外的任何可读介质，该可读介质可以发送、传播或者传输用于由指令执行系统、装置或者器件使用或者与其结合使用的程序。A computer readable signal medium may include a data signal carrying readable program code in baseband or as part of a carrier wave. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. A readable signal medium may also be any readable medium other than a readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device.
可读介质上包含的程序代码可以用任何适当的介质传输，包括但不限于无线、有线、光缆、RF等等，或者上述的任意合适的组合。Program code embodied on a readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
可以以一种或多种程序设计语言的任意组合来编写用于执行本发明操作的程序代码，所述程序设计语言包括面向对象的程序设计语言—诸如Java、C++等，还包括常规的过程式程序设计语言—诸如“C”语言或类似的程序设计语言。程序代码可以完全地在用户计算设备上执行、部分地在用户设备上执行、作为一个独立的软件包执行、部分在用户计算设备上部分在远程计算设备上执行、或者完全在远程计算设备或服务器上执行。在涉及远程计算设备的情形中，远程计算设备可以通过任意种类的网络，包括局域网(LAN)或广域网(WAN)，连接到用户计算设备，或者，可以连接到外部计算设备(例如利用因特网服务提供商来通过因特网连接)。Program code for carrying out the operations of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages—such as Java, C++, etc., as well as conventional procedural programming languages. Programming language - such as "C" or a similar programming language. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server to execute. In cases involving a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., using an Internet service provider). business to connect via the Internet).
在本发明的示例性实施例中，还提供了一种能够实现上述方法的电子设备。In an exemplary embodiment of the present invention, an electronic device capable of implementing the above method is also provided.
所属技术领域的技术人员能够理解，本发明的各个方面可以实现为系统、方法或程序产品。因此，本发明的各个方面可以具体实现为以下形式，即：完全的硬件实施方式、完全的软件实施方式(包括固件、微代码等)，或硬件和软件方面结合的实施方式，这里可以统称为“电路”、“模块”或“系统”。Those skilled in the art can understand that various aspects of the present invention can be implemented as systems, methods or program products. Therefore, various aspects of the present invention can be embodied in the following forms, that is: a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software implementations, which can be collectively referred to herein as "circuit", "module" or "system".
下面参照图11来描述根据本发明的这种实施方式的电子设备1100。图11显示的电子设备1100仅仅是一个示例，不应对本发明实施例的功能和使用范围带来任何限制。An electronic device 1100 according to this embodiment of the present invention is described below with reference to FIG. 11 . The electronic device 1100 shown in FIG. 11 is only an example, and should not limit the functions and scope of use of this embodiment of the present invention.
如图11所示，电子设备1100以通用计算设备的形式表现。电子设备1100的组件可以包括但不限于：上述至少一个处理单元1110、上述至少一个存储单元1120、连接不同系统组件(包括存储单元1120和处理单元1110)的总线1130、显示单元1140。As shown in FIG. 11 , electronic device 1100 takes the form of a general-purpose computing device. The components of the electronic device 1100 may include, but are not limited to: at least one processing unit 1110, at least one storage unit 1120, a bus 1130 connecting different system components (including the storage unit 1120 and the processing unit 1110), and a display unit 1140.
其中，所述存储单元存储有程序代码，所述程序代码可以被所述处理单元1110执行，使得所述处理单元1110执行本说明书上述“示例性方法”部分中描述的根据本发明各种示例性实施方式的步骤。例如，所述处理单元1110可以执行如图6中所示的步骤S60：通过基础数据仓库对各源系统的数据进行整合并存储整合后的数据；步骤S62：基于基础数据仓库按业务主题对不同源系统的共性数据进行分类存储；步骤S64：定义按业务主题进行分类存储的数据的数据指标并维护到目标维度表中，基于Spark架构进行数据查询和计算；步骤S66：根据用户提供的报表需求并结合按业务主题分类存储的数据和Spark架构进行报表开发。Wherein, the storage unit stores program codes, and the program codes can be executed by the processing unit 1110, so that the processing unit 1110 executes various exemplary methods according to the present invention described in the above "Exemplary Methods" section of this specification. Implementation steps. For example, the processing unit 1110 may execute step S60 as shown in FIG. 6: integrate the data of each source system through the basic data warehouse and store the integrated data; The common data of the source system is classified and stored; step S64: define the data indicators of the data classified and stored according to the business theme and maintain them in the target dimension table, and perform data query and calculation based on the Spark architecture; step S66: according to the report requirements provided by the user Combined with data stored by business theme and Spark architecture for report development.
存储单元1120可以包括易失性存储单元形式的可读介质，例如随机存取存储单元(RAM)11201和/或高速缓存存储单元11202，还可以进一步包括只读存储单元(ROM)11203。The storage unit 1120 may include a readable medium in the form of a volatile storage unit, such as a random access storage unit (RAM) 11201 and/or a cache storage unit 11202 , and may further include a read-only storage unit (ROM) 11203 .
存储单元1120还可以包括具有一组(至少一个)程序模块11205的程序/实用工具11204，这样的程序模块11205包括但不限于：操作系统、一个或者多个应用程序、其它程序模块以及程序数据，这些示例中的每一个或某种组合中可能包括网络环境的实现。Storage unit 1120 may also include programs/utilities 11204 having a set (at least one) of program modules 11205, such program modules 11205 including but not limited to: an operating system, one or more application programs, other program modules, and program data, Implementations of networked environments may be included in each or some combination of these examples.
总线1130可以为表示几类总线结构中的一种或多种，包括存储单元总线或者存储单元控制器、外围总线、图形加速端口、处理单元或者使用多种总线结构中的任意总线结构的局域总线。Bus 1130 may represent one or more of several types of bus structures, including a memory cell bus or memory cell controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local area using any of a variety of bus structures. bus.
电子设备1100也可以与一个或多个外部设备1200(例如键盘、指向设备、蓝牙设备等)通信，还可与一个或者多个使得用户能与该电子设备1100交互的设备通信，和/或与使得该电子设备1100能与一个或多个其它计算设备进行通信的任何设备(例如路由器、调制解调器等等)通信。这种通信可以通过输入/输出(I/O)接口1150进行。并且，电子设备1100还可以通过网络适配器1160与一个或者多个网络(例如局域网(LAN)，广域网(WAN)和/或公共网络，例如因特网)通信。如图所示，网络适配器1160通过总线1130与电子设备1100的其它模块通信。应当明白，尽管图中未示出，可以结合电子设备1100使用其它硬件和/或软件模块，包括但不限于：微代码、设备驱动器、冗余处理单元、外部磁盘驱动阵列、RAID系统、磁带驱动器以及数据备份存储系统等。The electronic device 1100 can also communicate with one or more external devices 1200 (such as keyboards, pointing devices, Bluetooth devices, etc.), and can also communicate with one or more devices that enable the user to interact with the electronic device 1100, and/or communicate with Any device (eg, router, modem, etc.) that enables the electronic device 1100 to communicate with one or more other computing devices. Such communication may occur through input/output (I/O) interface 1150 . Moreover, the electronic device 1100 can also communicate with one or more networks (such as a local area network (LAN), a wide area network (WAN) and/or a public network such as the Internet) through the network adapter 1160 . As shown, the network adapter 1160 communicates with other modules of the electronic device 1100 through the bus 1130 . It should be appreciated that although not shown, other hardware and/or software modules may be used in conjunction with electronic device 1100, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives And data backup storage system, etc.
通过以上的实施方式的描述，本领域的技术人员易于理解，这里描述的示例实施方式可以通过软件实现，也可以通过软件结合必要的硬件的方式来实现。因此，根据本公开实施方式的技术方案可以以软件产品的形式体现出来，该软件产品可以存储在一个非易失性存储介质(可以是CD-ROM，U盘，移动硬盘等)中或网络上，包括若干指令以使得一台计算设备(可以是个人计算机、服务器、终端装置、或者网络设备等)执行根据本公开实施方式的方法。Through the description of the above implementations, those skilled in the art can easily understand that the example implementations described here can be implemented by software, or by combining software with necessary hardware. Therefore, the technical solutions according to the embodiments of the present disclosure can be embodied in the form of software products, and the software products can be stored in a non-volatile storage medium (which can be CD-ROM, U disk, mobile hard disk, etc.) or on the network , including several instructions to make a computing device (which may be a personal computer, a server, a terminal device, or a network device, etc.) execute the method according to the embodiments of the present disclosure.
此外，上述附图仅是根据本发明示例性实施例的方法所包括的处理的示意性说明，而不是限制目的。易于理解，上述附图所示的处理并不表明或限制这些处理的时间顺序。另外，也易于理解，这些处理可以是例如在多个模块中同步或异步执行的。In addition, the above-mentioned figures are only schematic illustrations of the processes included in the method according to the exemplary embodiments of the present invention, and are not intended to be limiting. It is easy to understand that the processes shown in the above figures do not imply or limit the chronological order of these processes. In addition, it is also easy to understand that these processes may be executed synchronously or asynchronously in multiple modules, for example.
应当注意，尽管在上文详细描述中提及了用于动作执行的设备的若干模块或者单元，但是这种划分并非强制性的。实际上，根据本公开的实施方式，上文描述的两个或更多模块或者单元的特征和功能可以在一个模块或者单元中具体化。反之，上文描述的一个模块或者单元的特征和功能可以进一步划分为由多个模块或者单元来具体化。It should be noted that although several modules or units of the device for action execution are mentioned in the above detailed description, this division is not mandatory. Actually, according to the embodiment of the present disclosure, the features and functions of two or more modules or units described above may be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided to be embodied by a plurality of modules or units.
本领域技术人员在考虑说明书及实践这里公开的发明后，将容易想到本公开的其他实施例。本申请旨在涵盖本公开的任何变型、用途或者适应性变化，这些变型、用途或者适应性变化遵循本公开的一般性原理并包括本公开未公开的本技术领域中的公知常识或惯用技术手段。说明书和实施例仅被视为示例性的，本公开的真正范围和精神由权利要求指出。Other embodiments of the disclosure will be readily apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any modification, use or adaptation of the present disclosure, and these modifications, uses or adaptations follow the general principles of the present disclosure and include common knowledge or conventional technical means in the technical field not disclosed in the present disclosure . The specification and examples are to be considered exemplary only, with the true scope and spirit of the disclosure indicated by the appended claims.
应当理解的是，本公开并不局限于上面已经描述并在附图中示出的精确结构，并且可以在不脱离其范围进行各种修改和改变。本公开的范围仅由所附的权利要求来限。It should be understood that the present disclosure is not limited to the precise constructions which have been described above and shown in the drawings, and various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711127508.8ACN107918600B (en) | 2017-11-15 | 2017-11-15 | Report development system and method, storage medium and electronic equipment |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711127508.8ACN107918600B (en) | 2017-11-15 | 2017-11-15 | Report development system and method, storage medium and electronic equipment |
| Publication Number | Publication Date |
|---|---|
| CN107918600Atrue CN107918600A (en) | 2018-04-17 |
| CN107918600B CN107918600B (en) | 2021-11-23 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711127508.8AActiveCN107918600B (en) | 2017-11-15 | 2017-11-15 | Report development system and method, storage medium and electronic equipment |
| Country | Link |
|---|---|
| CN (1) | CN107918600B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108664638A (en)* | 2018-05-15 | 2018-10-16 | 口碑(上海)信息技术有限公司 | Report form generation method based on index system and device |
| CN109272223A (en)* | 2018-09-06 | 2019-01-25 | 广州微印信息科技有限公司 | One kind being based on section's purpose task cooperative system and method |
| CN109376147A (en)* | 2018-11-26 | 2019-02-22 | 浙江中智达科技有限公司 | A kind of data processing method and system |
| CN109617734A (en)* | 2018-12-25 | 2019-04-12 | 北京市天元网络技术股份有限公司 | Network operation capability analysis method and device |
| CN109634941A (en)* | 2018-11-14 | 2019-04-16 | 金色熊猫有限公司 | Medical data processing method, device, electronic equipment and storage medium |
| CN110458743A (en)* | 2019-08-12 | 2019-11-15 | 软通动力信息技术有限公司 | Community governance method, device, equipment and storage medium based on big data analysis |
| CN110751575A (en)* | 2019-10-21 | 2020-02-04 | 中国民航信息网络股份有限公司 | Method and device for processing civil aviation passenger service data |
| CN110807016A (en)* | 2019-09-29 | 2020-02-18 | 北京淇瑀信息科技有限公司 | Data warehouse construction method and device applied to financial business and electronic equipment |
| CN110825749A (en)* | 2019-11-05 | 2020-02-21 | 泰康保险集团股份有限公司 | Behavior trajectory analysis and display method and device, electronic equipment and storage medium |
| CN110990355A (en)* | 2019-11-25 | 2020-04-10 | 东莞理工学院 | An information classification system for big data analysis based on Skynet |
| CN111045982A (en)* | 2019-11-20 | 2020-04-21 | 东莞理工学院 | A data collection system with recording function for big data analysis |
| CN111047427A (en)* | 2019-11-26 | 2020-04-21 | 深圳市卡牛科技有限公司 | Data reporting method, device, server and storage medium |
| CN111126019A (en)* | 2019-11-28 | 2020-05-08 | 泰康保险集团股份有限公司 | Report generation method and device based on mode customization and electronic equipment |
| CN111143356A (en)* | 2019-12-12 | 2020-05-12 | 中盈优创资讯科技有限公司 | Report retrieval method and device |
| CN111382193A (en)* | 2018-12-28 | 2020-07-07 | 顺丰科技有限公司 | Method and device for constructing data warehouse topic model |
| CN111639068A (en)* | 2020-05-24 | 2020-09-08 | 中信银行股份有限公司 | Multi-system-based public data pool generation method, device, equipment and readable storage medium |
| CN111708992A (en)* | 2020-05-06 | 2020-09-25 | 咪咕文化科技有限公司 | Report data access method, device, electronic device and storage medium |
| CN111768850A (en)* | 2020-06-05 | 2020-10-13 | 上海森亿医疗科技有限公司 | Hospital data analysis method, hospital data analysis platform, device and medium |
| CN112182089A (en)* | 2020-10-15 | 2021-01-05 | 南方电网数字电网研究院有限公司 | Report generation method, device and equipment based on data warehouse model |
| CN112241367A (en)* | 2020-09-25 | 2021-01-19 | 建信金融科技有限责任公司 | Data line testing method and device |
| CN112699128A (en)* | 2020-12-31 | 2021-04-23 | 新奥数能科技有限公司 | Report generation method and device, readable storage medium and electronic equipment |
| CN112862428A (en)* | 2021-01-18 | 2021-05-28 | 北京神州数字科技有限公司 | Supervision reporting system based on micro-service |
| CN112947844A (en)* | 2019-12-11 | 2021-06-11 | 北京金山云网络技术有限公司 | Data storage method and device, electronic equipment and medium |
| WO2021139427A1 (en)* | 2020-07-23 | 2021-07-15 | 平安科技（深圳）有限公司 | Big data index construction method, apparatus and device, and storage medium |
| CN113128910A (en)* | 2021-05-13 | 2021-07-16 | 中国建设银行股份有限公司 | Method, device, equipment and storage medium for constructing data application portal system |
| CN113449501A (en)* | 2020-03-24 | 2021-09-28 | 腾讯科技（深圳）有限公司 | Document editing method and device, computer equipment and storage medium |
| CN113535687A (en)* | 2021-07-29 | 2021-10-22 | 北京互金新融科技有限公司 | Data variable management method and device, computer readable storage medium and processor |
| CN113946620A (en)* | 2021-10-14 | 2022-01-18 | 车智互联（北京）科技有限公司 | A method, device and computing device for creating visual data |
| CN114328505A (en)* | 2021-11-17 | 2022-04-12 | 宝付网络科技（上海）有限公司 | A system and method for automatic generation of general capital statement |
| CN115858691A (en)* | 2022-11-17 | 2023-03-28 | 北京白龙马云行科技有限公司 | Report creation method and device, electronic equipment and medium |
| CN117194456A (en)* | 2023-09-19 | 2023-12-08 | 国任财产保险股份有限公司 | Policy registration management system |
| CN118827216A (en)* | 2024-07-30 | 2024-10-22 | 国网山东省电力公司威海供电公司 | An attack protection system based on RASP |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1901477A (en)* | 2006-07-12 | 2007-01-24 | 华为技术有限公司 | Searching method and its system for equipment traffic data |
| US20080243785A1 (en)* | 2007-03-30 | 2008-10-02 | Tyron Jerrod Stading | System and methods of searching data sources |
| CN105608203A (en)* | 2015-12-24 | 2016-05-25 | Tcl集团股份有限公司 | Internet of things log processing method and device based on Hadoop platform |
| US20160162521A1 (en)* | 2014-12-08 | 2016-06-09 | Platfora, Inc. | Systems and Methods for Data Ingest in Interest-Driven Business Intelligence Systems |
| CN105912636A (en)* | 2016-04-08 | 2016-08-31 | 金蝶软件（中国）有限公司 | Map/Reduce based ETL data processing method and device |
| US20160321589A1 (en)* | 2012-06-05 | 2016-11-03 | Dimensional Insight Incorporated | Dynamic generation of guided pages |
| CN106294521A (en)* | 2015-06-12 | 2017-01-04 | 交通银行股份有限公司 | Date storage method and data warehouse |
| CN106682213A (en)* | 2016-12-30 | 2017-05-17 | Tcl集团股份有限公司 | Internet-of-things task customizing method and system based on Hadoop platform |
| US20170139674A1 (en)* | 2015-11-18 | 2017-05-18 | American Express Travel Related Services Company, Inc. | Systems and methods for tracking sensitive data in a big data environment |
| CN107168940A (en)* | 2017-03-29 | 2017-09-15 | 长春市万易科技有限公司 | A kind of report generating system and method |
| CN107193967A (en)* | 2017-05-25 | 2017-09-22 | 南开大学 | A kind of multi-source heterogeneous industry field big data handles full link solution |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1901477A (en)* | 2006-07-12 | 2007-01-24 | 华为技术有限公司 | Searching method and its system for equipment traffic data |
| US20080243785A1 (en)* | 2007-03-30 | 2008-10-02 | Tyron Jerrod Stading | System and methods of searching data sources |
| US20160321589A1 (en)* | 2012-06-05 | 2016-11-03 | Dimensional Insight Incorporated | Dynamic generation of guided pages |
| US20160162521A1 (en)* | 2014-12-08 | 2016-06-09 | Platfora, Inc. | Systems and Methods for Data Ingest in Interest-Driven Business Intelligence Systems |
| CN106294521A (en)* | 2015-06-12 | 2017-01-04 | 交通银行股份有限公司 | Date storage method and data warehouse |
| US20170139674A1 (en)* | 2015-11-18 | 2017-05-18 | American Express Travel Related Services Company, Inc. | Systems and methods for tracking sensitive data in a big data environment |
| CN105608203A (en)* | 2015-12-24 | 2016-05-25 | Tcl集团股份有限公司 | Internet of things log processing method and device based on Hadoop platform |
| CN105912636A (en)* | 2016-04-08 | 2016-08-31 | 金蝶软件（中国）有限公司 | Map/Reduce based ETL data processing method and device |
| CN106682213A (en)* | 2016-12-30 | 2017-05-17 | Tcl集团股份有限公司 | Internet-of-things task customizing method and system based on Hadoop platform |
| CN107168940A (en)* | 2017-03-29 | 2017-09-15 | 长春市万易科技有限公司 | A kind of report generating system and method |
| CN107193967A (en)* | 2017-05-25 | 2017-09-22 | 南开大学 | A kind of multi-source heterogeneous industry field big data handles full link solution |
| Title |
|---|
| BAO RONG CHANG等: "Optimized Multiple Platforms for Big Data Analysis", 《2016 IEEE SECOND INTERNATIONAL CONFERENCE ON MULTIMEDIA BIG DATA (BIGMM)》* |
| XIUQIN LIN等: "Log analysis in cloud computing environment with Hadoop and Spark", 《2013 5TH IEEE INTERNATIONAL CONFERENCE ON BROADBAND NETWORK & MULTIMEDIA TECHNOLOGY》* |
| 王志刚: "企业级数据中心设计与实践", 《信息技术与标准化》* |
| 赵毅: "基于大数据平台构建数据仓库的研究与实践", 《中国金融电脑》* |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108664638B (en)* | 2018-05-15 | 2019-12-10 | 口碑(上海)信息技术有限公司 | report generation method and device based on index system |
| CN108664638A (en)* | 2018-05-15 | 2018-10-16 | 口碑(上海)信息技术有限公司 | Report form generation method based on index system and device |
| CN109272223A (en)* | 2018-09-06 | 2019-01-25 | 广州微印信息科技有限公司 | One kind being based on section's purpose task cooperative system and method |
| CN109634941A (en)* | 2018-11-14 | 2019-04-16 | 金色熊猫有限公司 | Medical data processing method, device, electronic equipment and storage medium |
| CN109376147A (en)* | 2018-11-26 | 2019-02-22 | 浙江中智达科技有限公司 | A kind of data processing method and system |
| CN109617734A (en)* | 2018-12-25 | 2019-04-12 | 北京市天元网络技术股份有限公司 | Network operation capability analysis method and device |
| CN109617734B (en)* | 2018-12-25 | 2021-12-07 | 北京市天元网络技术股份有限公司 | Network operation capability analysis method and device |
| CN111382193A (en)* | 2018-12-28 | 2020-07-07 | 顺丰科技有限公司 | Method and device for constructing data warehouse topic model |
| CN110458743A (en)* | 2019-08-12 | 2019-11-15 | 软通动力信息技术有限公司 | Community governance method, device, equipment and storage medium based on big data analysis |
| CN110807016A (en)* | 2019-09-29 | 2020-02-18 | 北京淇瑀信息科技有限公司 | Data warehouse construction method and device applied to financial business and electronic equipment |
| CN110751575A (en)* | 2019-10-21 | 2020-02-04 | 中国民航信息网络股份有限公司 | Method and device for processing civil aviation passenger service data |
| CN110825749A (en)* | 2019-11-05 | 2020-02-21 | 泰康保险集团股份有限公司 | Behavior trajectory analysis and display method and device, electronic equipment and storage medium |
| CN111045982A (en)* | 2019-11-20 | 2020-04-21 | 东莞理工学院 | A data collection system with recording function for big data analysis |
| CN110990355A (en)* | 2019-11-25 | 2020-04-10 | 东莞理工学院 | An information classification system for big data analysis based on Skynet |
| CN111047427A (en)* | 2019-11-26 | 2020-04-21 | 深圳市卡牛科技有限公司 | Data reporting method, device, server and storage medium |
| CN111126019A (en)* | 2019-11-28 | 2020-05-08 | 泰康保险集团股份有限公司 | Report generation method and device based on mode customization and electronic equipment |
| CN111126019B (en)* | 2019-11-28 | 2024-01-05 | 泰康保险集团股份有限公司 | Report generation method and device based on mode customization and electronic equipment |
| CN112947844A (en)* | 2019-12-11 | 2021-06-11 | 北京金山云网络技术有限公司 | Data storage method and device, electronic equipment and medium |
| CN111143356A (en)* | 2019-12-12 | 2020-05-12 | 中盈优创资讯科技有限公司 | Report retrieval method and device |
| CN111143356B (en)* | 2019-12-12 | 2023-08-01 | 中盈优创资讯科技有限公司 | Report retrieval method and device |
| CN113449501A (en)* | 2020-03-24 | 2021-09-28 | 腾讯科技（深圳）有限公司 | Document editing method and device, computer equipment and storage medium |
| CN113449501B (en)* | 2020-03-24 | 2024-06-11 | 腾讯科技（深圳）有限公司 | Document editing method, device, computer equipment and storage medium |
| CN111708992B (en)* | 2020-05-06 | 2023-07-14 | 咪咕文化科技有限公司 | Report data access method, device, electronic equipment and storage medium |
| CN111708992A (en)* | 2020-05-06 | 2020-09-25 | 咪咕文化科技有限公司 | Report data access method, device, electronic device and storage medium |
| CN111639068A (en)* | 2020-05-24 | 2020-09-08 | 中信银行股份有限公司 | Multi-system-based public data pool generation method, device, equipment and readable storage medium |
| CN111768850B (en)* | 2020-06-05 | 2021-08-27 | 上海森亿医疗科技有限公司 | Hospital data analysis method, hospital data analysis platform, device and medium |
| CN111768850A (en)* | 2020-06-05 | 2020-10-13 | 上海森亿医疗科技有限公司 | Hospital data analysis method, hospital data analysis platform, device and medium |
| WO2021139427A1 (en)* | 2020-07-23 | 2021-07-15 | 平安科技（深圳）有限公司 | Big data index construction method, apparatus and device, and storage medium |
| CN112241367A (en)* | 2020-09-25 | 2021-01-19 | 建信金融科技有限责任公司 | Data line testing method and device |
| CN112241367B (en)* | 2020-09-25 | 2022-09-13 | 建信金融科技有限责任公司 | Data line testing method and device |
| CN112182089A (en)* | 2020-10-15 | 2021-01-05 | 南方电网数字电网研究院有限公司 | Report generation method, device and equipment based on data warehouse model |
| CN112699128A (en)* | 2020-12-31 | 2021-04-23 | 新奥数能科技有限公司 | Report generation method and device, readable storage medium and electronic equipment |
| CN112862428A (en)* | 2021-01-18 | 2021-05-28 | 北京神州数字科技有限公司 | Supervision reporting system based on micro-service |
| CN112862428B (en)* | 2021-01-18 | 2023-10-13 | 北京神州数字科技有限公司 | Supervision reporting system based on micro-service |
| CN113128910A (en)* | 2021-05-13 | 2021-07-16 | 中国建设银行股份有限公司 | Method, device, equipment and storage medium for constructing data application portal system |
| CN113535687A (en)* | 2021-07-29 | 2021-10-22 | 北京互金新融科技有限公司 | Data variable management method and device, computer readable storage medium and processor |
| CN113535687B (en)* | 2021-07-29 | 2024-01-26 | 北京互金新融科技有限公司 | Data variable management method, device, computer readable storage medium and processor |
| CN113946620A (en)* | 2021-10-14 | 2022-01-18 | 车智互联（北京）科技有限公司 | A method, device and computing device for creating visual data |
| CN113946620B (en)* | 2021-10-14 | 2025-02-11 | 车智互联（北京）科技有限公司 | A method, device and computing device for creating visual data |
| CN114328505A (en)* | 2021-11-17 | 2022-04-12 | 宝付网络科技（上海）有限公司 | A system and method for automatic generation of general capital statement |
| CN115858691A (en)* | 2022-11-17 | 2023-03-28 | 北京白龙马云行科技有限公司 | Report creation method and device, electronic equipment and medium |
| CN117194456A (en)* | 2023-09-19 | 2023-12-08 | 国任财产保险股份有限公司 | Policy registration management system |
| CN117194456B (en)* | 2023-09-19 | 2024-09-03 | 国任财产保险股份有限公司 | Policy registration management system |
| CN118827216A (en)* | 2024-07-30 | 2024-10-22 | 国网山东省电力公司威海供电公司 | An attack protection system based on RASP |
| Publication number | Publication date |
|---|---|
| CN107918600B (en) | 2021-11-23 |
| Publication | Publication Date | Title |
|---|---|---|
| CN107918600B (en) | Report development system and method, storage medium and electronic equipment | |
| US12229642B2 (en) | Efficient duplicate detection for machine learning data sets | |
| CN110795509B (en) | Method and device for constructing index blood-margin relation graph of data warehouse and electronic equipment | |
| US11615076B2 (en) | Monolith database to distributed database transformation | |
| CA2953826C (en) | Machine learning service | |
| CN104809597A (en) | Data resource management platform based on data fusion | |
| Sivaraman et al. | High performance and fault tolerant distributed file system for big data storage and processing using hadoop | |
| CN111951935A (en) | Medical cloud system, method, system and medium for medical big data processing | |
| Noh et al. | Bigdata platform design and implementation model | |
| CN111221698A (en) | Task data collection method and device | |
| CN115640300A (en) | Big data management method, system, electronic equipment and storage medium | |
| CN117610532A (en) | Report generation method and system, electronic equipment and storage medium | |
| Liu et al. | Development and application of massive unstructured big data retrieval technology based on cloud computing platform | |
| CN116052893A (en) | Medical information management method, device and electronic equipment based on medical big data | |
| US11630663B2 (en) | Compressing multi-attribute vector into a single eigenvalue for ranking subject matter experts | |
| Jadhav et al. | A Practical approach for integrating Big data Analytics into E-governance using hadoop | |
| US20250110786A1 (en) | Agent ops framework | |
| KR102572978B1 (en) | Machine learning-based data preprocessing device and method | |
| Haddad et al. | Machine learning analytics-based distributed frameworks: a survey | |
| Doan | A Framework for Integrating IoT Streaming Data from Multiple Sources | |
| Feng | Discussion on the Design of Cloud Computing Audit System Based on Data Center | |
| CN114610507A (en) | Application service processing method, device, equipment, storage medium and program product | |
| CN120104700A (en) | Real-time data warehouse index calculation system, method, device, equipment and storage medium | |
| CN117033347A (en) | Method, system, equipment and medium for modeling number bins based on patent data | |
| Tsai et al. | Flexible-Matching Data-Comparison Tool with the Cloud Applications |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |