Disclosure of Invention
The invention provides a processing method, a device, equipment and a storage medium for ship service data, which can automatically process the service data in a supply chain management system, improve the processing efficiency of the service data and enhance the level of collaborative management among enterprises.
In order to solve the above technical problems, an embodiment of the present invention provides a method for processing ship service data, including:
generating a data stream configuration interface; wherein the data flow configuration interface comprises: editing a control selected area and a data stream design area; the editing control comprises: the device comprises an input control for acquiring data to be processed, an output control for storing the processed data and a data processing control for indicating a data processing mode;
detecting the editing controls dragged from the editing control selected area to the data stream design area by the user, and determining all the editing controls dragged to the data stream design area by the user and the connection relation among all the controls;
when the existence of an input control in the data stream design area is detected, acquiring data to be processed corresponding to the input control;
when detecting that a data processing control exists in the data flow design area, determining a data processing mode corresponding to data to be processed and a data processing sequence corresponding to each data processing mode;
When detecting that an output control exists in the data flow design area, determining the table name of a data output table to be generated;
and processing the data to be processed according to the data processing sequence corresponding to each processing mode to generate processed data, and then generating a data output table according to the processed data and the table name.
Preferably, the obtaining the data to be processed corresponding to the input control includes:
extracting configuration information of an input control; wherein the configuration information includes: inputting a target data form and a target form field corresponding to the control;
selecting a data value of a corresponding field from the target data form according to the target form field to obtain the data to be processed;
the configuration of the configuration information of the input control comprises the following steps:
responding to the configuration operation acted on the input control, and generating a data source configuration interface; wherein the data source configuration interface comprises: a data form selection area for selecting a data form, and a form field selection area for selecting a form field;
responding to a data form selection operation acting on the data form selection area, and determining a target data form corresponding to the input control;
And responding to the form field selection operation acting on the form field selection area, and determining a target form field corresponding to the input control.
Preferably, the data processing control comprises: the transverse connection control is used for configuring a connection mode and a connection field corresponding to the data form;
when detecting that a transverse connection control exists in a data flow design area, determining a connection mode and a connection field of an input control corresponding to the transverse connection control and a target data form corresponding to the input control, so that when processing the data to be processed, a target form field identical to the connection field is found in each target data form according to the connection field to be used as a form field to be connected;
according to the connection mode, every target data form is connected in pairs at the word section of every form to be connected;
the configuration of the transverse connection control comprises the following steps:
responding to the configuration operation acted on the transverse connection control, and generating a transverse connection control configuration interface; wherein, the cross-connect control configuration interface comprises: a connection mode selection area and a connection field selection area;
Responding to the connection mode selection operation acted on the connection mode selection area, and determining the connection mode of the target data form of the input control corresponding to the transverse connection control;
and determining the connection field of the target data form of the input control corresponding to the transverse connection control in response to the connection field selection operation acting on the connection field selection area.
Preferably, the data processing control further includes: an additional merge control for merging the form fields;
when the existence of an additional merging control in the data flow design area is detected, determining an input control corresponding to the additional merging control, so that when the data to be processed is processed, the field names and the data types of all the target form fields in each target data form are identified, and the target form fields with the same field names and data types are merged.
Preferably, after merging the target form fields with the same field name and data type, the method further comprises:
responding to the field name setting operation of the user, and determining the combined field name of each combined target form field;
setting the field name of each combined target form field as the combined field name.
Preferably, the data processing control further includes: the grouping summarization control is used for configuring grouping fields and summarization modes corresponding to the data forms;
when detecting that a grouping summarization control exists in a data flow design area, determining an input control corresponding to the grouping summarization control and a grouping field and a summarization mode of a target data form corresponding to the input control, so that when the data to be processed is processed, the target form fields which are the same as the grouping field in each target data form are divided into one group according to the grouping field;
according to the summarizing mode, summarizing and calculating each group; wherein, the summarizing mode includes: counting and de-duplication counting;
the configuration process of the grouping summarization control comprises the following steps:
generating a grouping summary control configuration interface; wherein, the grouping summary control configuration interface comprises: grouping field selection areas and summary setting areas;
responding to the grouping field selection operation of the user in the grouping field selection area, and determining the grouping field of the target data form of the input control corresponding to the grouping summarization control;
And responding to the operation of selecting the summarization field of the summarization setting area by the user, and determining the summarization mode of each group.
Preferably, the data processing control further includes: the data screening control is used for configuring a screening mode and a screening condition corresponding to the data form;
when detecting that a data screening control exists in a data flow design area, determining an input control corresponding to the data screening control and a screening mode and screening conditions of a target data form corresponding to the input control, so that when processing the data to be processed, extracting target form fields meeting the screening conditions from each target data form according to the screening mode; wherein, the screening mode includes: all screening conditions are met or any screening condition is met;
the configuration process of the data screening control comprises the following steps:
generating a data screening control configuration interface; wherein, the data screening control configuration interface includes: a screening mode selection area and a screening condition setting area;
responding to the screening mode selection operation of the user in the screening mode selection area, and determining the screening mode of the target data form of the input control corresponding to the data screening control;
And responding to the screening condition setting operation of the user in the screening condition setting area, and determining the screening condition of the target data form of the input control corresponding to the data screening control.
Preferably, the data processing control further includes: a field setting control for configuring a field name corresponding to a form field;
when detecting that a field setting control exists in a data flow design area, determining an input control corresponding to the field setting control and a field name to be set of a target form field corresponding to the input control, so that when processing the data to be processed, setting the field name of the target form field according to the field name to be set;
the configuration process of the field setting control comprises the following steps:
generating a field setting control configuration interface; wherein the field setting control configuration interface comprises: a field name setting area;
and responding to the field name setting operation of the user in the field name setting area, and determining the field name of the target form field of the input control corresponding to the field setting control.
As a preferred solution, the method for processing ship service data further includes:
Responding to an aggregation table creation instruction of a user, and generating an aggregation table configuration interface; wherein the aggregate table configuration interface comprises: a name setting area, a data source selection area, a row header setting area and an aggregation index setting area;
determining a table name of the aggregation table in response to a name setting operation acting in the name setting area;
responding to data source selection operation acted in the data source selection area, and acquiring a data form to be aggregated;
determining header fields of the aggregate table in response to a row header setting operation acting on the row header setting area;
determining an aggregation indicator of the aggregation table in response to an aggregation indicator setting acting within the aggregation indicator setting area;
and carrying out data aggregation on the data forms to be aggregated according to the aggregation index to generate aggregation data, and then generating an aggregation output table according to the aggregation data, the table names of the aggregation tables and the table header fields of the aggregation tables.
Preferably, the data source selecting area further comprises: setting a sub-region for the filtering condition;
after the data form to be aggregated is acquired, the method further comprises:
when the filtering condition setting operation exists in the filtering condition setting subarea, determining the filtering condition of the data form to be aggregated;
And eliminating the form fields which do not meet the filtering conditions in the data forms to be aggregated.
Preferably, after the data form to be aggregated is acquired, the method further includes:
when the data forms to be aggregated contain a plurality of data forms, identifying field names of the form fields in each data form to be aggregated, and merging the form fields with the same field names in each data form to be aggregated.
On the basis of the above embodiment, another embodiment of the present invention provides a processing device for ship service data, including: the system comprises a data stream configuration interface generation module, an editing control determination module, a data acquisition module to be processed, a data determination module to be processed, a table name determination module and a data output table generation module;
the data stream configuration interface generation module is used for generating a data stream configuration interface; wherein the data flow configuration interface comprises: editing a control selected area and a data stream design area; the editing control comprises: the device comprises an input control for acquiring data to be processed, an output control for storing the processed data and a data processing control for indicating a data processing mode;
The editing control determining module is used for detecting the editing controls dragged from the selected area of the editing control to the data flow design area by the user and determining all the editing controls dragged to the data flow design area by the user and the connection relation among all the controls;
the data to be processed acquisition module is used for acquiring data to be processed corresponding to an input control when the input control exists in the data flow design area;
the data to be processed determining module is used for determining a data processing mode corresponding to data to be processed and a data processing sequence corresponding to each data processing mode when detecting that a data processing control exists in the data flow design area;
the table name determining module is used for determining the table name of the data output table to be generated when the output control exists in the data flow design area;
the data output table generating module is used for processing the data to be processed according to the data processing sequence corresponding to each processing mode to generate processed data, and then generating a data output table according to the processed data and the table name.
On the basis of the above embodiments, a further embodiment of the present invention provides a processing device for ship service data, where the device includes a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, where the processor executes the computer program to implement the processing method for ship service data according to the embodiment of the present invention.
On the basis of the above embodiment, a further embodiment of the present invention provides a storage medium, where the storage medium includes a stored computer program, where the computer program controls a device where the storage medium is located to execute the method for processing ship service data according to the above embodiment of the present invention when running.
Compared with the prior art, the embodiment of the invention has the following beneficial effects:
according to the method, the connection relation between all editing controls dragged to the data stream design area by the user and all controls is determined by detecting the editing controls dragged to the data stream design area by the user from the editing control selected area; when the existence of an input control in the data stream design area is detected, acquiring data to be processed corresponding to the input control; when detecting that a data processing control exists in the data flow design area, determining a data processing mode corresponding to data to be processed and a data processing sequence corresponding to each data processing mode; when detecting that an output control exists in the data flow design area, determining the table name of a data output table to be generated; and processing the data to be processed according to the data processing sequence corresponding to each processing mode to generate processed data, and then generating a data output table according to the processed data and the table name.
Compared with the mode of integrating and processing ship service data manually in the prior art, the method and the device have the advantages that through determining the connection relation between each editing control and each control dragged to the data flow design area by a user, configuring the data flow according to the connection relation between each editing control and each control, then processing the data to be processed through the configured data flow, processing the service data in the supply chain management system can be automatically performed, the processing efficiency of the service data is improved, and the level of collaborative management among enterprises is enhanced.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Example 1
Referring to fig. 1, a flow chart of a processing method of ship service data according to an embodiment of the invention includes the following specific steps:
s1, generating a data stream configuration interface; wherein the data flow configuration interface comprises: editing a control selected area and a data stream design area; the editing control comprises: the device comprises an input control for acquiring data to be processed, an output control for storing the processed data and a data processing control for indicating a data processing mode;
in the present invention, the business data is processed in the form of a data factory, and in a specific embodiment, the data factory may be applied to process the business data of the ship industry supply chain management scenario, and referring to fig. 2, the overall data processing flow diagram of the data factory is shown.
The data factory comprises a data source, a data stream and a data output table, and specifically comprises the following steps:
a data stream, i.e., a workflow of processing process data; if the data plant is compared with a production plant, the data flow is equivalent to a pipeline in the plant, and a plurality of pipelines are arranged in one plant and are independent of each other to operate efficiently, and the data flow of the data plant is also the same.
A data source, i.e. a source of data, enters the data stream through the input node; if the data factory is compared to a production factory, the data source is equivalent to the raw material of the production process.
The output table, namely the result table after data flow operation processing, can only output one result table by one data flow; if the data plant is compared to a production plant, the pipeline will eventually output a product, the output table being the product.
When the data factory is used for processing ship service data, the configuration process of the data source, the data stream and the output table of the data factory is as follows:
(1) Data source: the data source of the data factory is input through the input control, and the input data forms can be obtained through Excel import, form collection and API interfacing. The Excel importing and form collecting are realized by calling the data of the internal system of the enterprise, the API docking is realized by docking the interface of the external system, and referring to FIG. 3, an API docking management interface of a data source is a schematic diagram, and two types of data of API or SQL can be selectively added to realize the service data of the external system.
(2) Data flow: referring to fig. 4, a schematic diagram of a data stream configuration interface is shown, and when configuring a data stream, a data stream configuration interface is first generated, where the data stream configuration interface includes: editing a control selected area and a data stream design area; the editing control comprises: the system comprises an input control for acquiring data to be processed, an output control for storing the processed data, and a data processing control for indicating a data processing mode.
(3) Output table: referring to fig. 5, in order to output an interface schematic diagram of a data table, an output control is clicked, and a data table is output after calculation through a configured data stream.
S2, detecting the editing controls dragged from the editing control selected area to the data stream design area by the user, and determining all the editing controls dragged to the data stream design area by the user and the connection relation among all the controls;
in the data stream configuration interface, required input controls, data processing controls and output controls are selected from the selected area of the editing control, dragged to the data stream design area, and all the controls are connected according to a certain sequence, so that the configuration of the data stream can be completed. After the configuration is completed, the system automatically detects the edit controls dragged from the selected area of the edit controls to the data stream design area by the user, and determines all the edit controls dragged to the data stream design area by the user and the connection relation among all the controls.
S3, when the existence of the input control in the data stream design area is detected, acquiring data to be processed corresponding to the input control;
preferably, the obtaining the data to be processed corresponding to the input control includes: extracting configuration information of an input control; wherein the configuration information includes: inputting a target data form and a target form field corresponding to the control; selecting a data value of a corresponding field from the target data form according to the target form field to obtain the data to be processed; the configuration of the configuration information of the input control comprises the following steps: responding to the configuration operation acted on the input control, and generating a data source configuration interface; wherein the data source configuration interface comprises: a data form selection area for selecting a data form, and a form field selection area for selecting a form field; responding to a data form selection operation acting on the data form selection area, and determining a target data form corresponding to the input control; and responding to the form field selection operation acting on the form field selection area, and determining a target form field corresponding to the input control.
A. The configuration process of the input control is as follows: the input control is used for selecting the data to be processed, one input control is dragged from the selected area of the editing control to the data flow design area to be added, and the data form and the form field can be selected by clicking the input control.
Referring to fig. 6, an adding flow interface diagram of an input control is shown, and when a data source is input in the data flow configuration interface, one input control is selected to be dragged to a data flow design area. Referring to fig. 7, for a configuration interface diagram of an input control, the input control is selected, the control may be configured in detail, and one or more data forms and corresponding form fields may be selected as a data source. Referring to fig. 8, in the view of the browsing interface of the data source, after selecting the corresponding data source, the input control may be clicked to preview the data source. Referring to fig. 9, a flow chart of replacing a data source is shown, and if the data source selection is erroneously changed, the input control can be clicked to replace the data source.
S4, when the existence of a data processing control in the data flow design area is detected, determining a data processing mode corresponding to data to be processed and a data processing sequence corresponding to each data processing mode;
Preferably, the data processing control comprises: the transverse connection control is used for configuring a connection mode and a connection field corresponding to the data form; when detecting that a transverse connection control exists in a data flow design area, determining a connection mode and a connection field of an input control corresponding to the transverse connection control and a target data form corresponding to the input control, so that when processing the data to be processed, a target form field identical to the connection field is found in each target data form according to the connection field to be used as a form field to be connected; according to the connection mode, every target data form is connected in pairs at the word section of every form to be connected; the configuration of the transverse connection control comprises the following steps: responding to the configuration operation acted on the transverse connection control, and generating a transverse connection control configuration interface; wherein, the cross-connect control configuration interface comprises: a connection mode selection area and a connection field selection area; responding to the connection mode selection operation acted on the connection mode selection area, and determining the connection mode of the target data form of the input control corresponding to the transverse connection control; and determining the connection field of the target data form of the input control corresponding to the transverse connection control in response to the connection field selection operation acting on the connection field selection area.
Preferably, the data processing control further comprises: an additional merge control for merging the form fields; when the existence of an additional merging control in the data flow design area is detected, determining an input control corresponding to the additional merging control, so that when the data to be processed is processed, the field names and the data types of all the target form fields in each target data form are identified, and the target form fields with the same field names and data types are merged.
Preferably, after merging the target form fields with the same field name and data type, the method further comprises: responding to the field name setting operation of the user, and determining the combined field name of each combined target form field; setting the field name of each combined target form field as the combined field name.
Preferably, the data processing control further comprises: the grouping summarization control is used for configuring grouping fields and summarization modes corresponding to the data forms; when detecting that a grouping summarization control exists in a data flow design area, determining an input control corresponding to the grouping summarization control and a grouping field and a summarization mode of a target data form corresponding to the input control, so that when the data to be processed is processed, the target form fields which are the same as the grouping field in each target data form are divided into one group according to the grouping field; according to the summarizing mode, summarizing and calculating each group; wherein, the summarizing mode includes: counting and de-duplication counting; the configuration process of the grouping summarization control comprises the following steps: generating a grouping summary control configuration interface; wherein, the grouping summary control configuration interface comprises: grouping field selection areas and summary setting areas; responding to the grouping field selection operation of the user in the grouping field selection area, and determining the grouping field of the target data form of the input control corresponding to the grouping summarization control; and responding to the operation of selecting the summarization field of the summarization setting area by the user, and determining the summarization mode of each group.
Preferably, the data processing control further comprises: the data screening control is used for configuring a screening mode and a screening condition corresponding to the data form; when detecting that a data screening control exists in a data flow design area, determining an input control corresponding to the data screening control and a screening mode and screening conditions of a target data form corresponding to the input control, so that when processing the data to be processed, extracting target form fields meeting the screening conditions from each target data form according to the screening mode; wherein, the screening mode includes: all screening conditions are met or any screening condition is met; the configuration process of the data screening control comprises the following steps: generating a data screening control configuration interface; wherein, the data screening control configuration interface includes: a screening mode selection area and a screening condition setting area; responding to the screening mode selection operation of the user in the screening mode selection area, and determining the screening mode of the target data form of the input control corresponding to the data screening control; and responding to the screening condition setting operation of the user in the screening condition setting area, and determining the screening condition of the target data form of the input control corresponding to the data screening control.
Preferably, the data processing control further comprises: a field setting control for configuring a field name corresponding to a form field; when detecting that a field setting control exists in a data flow design area, determining an input control corresponding to the field setting control and a field name to be set of a target form field corresponding to the input control, so that when processing the data to be processed, setting the field name of the target form field according to the field name to be set; the configuration process of the field setting control comprises the following steps: generating a field setting control configuration interface; wherein the field setting control configuration interface comprises: a field name setting area; and responding to the field name setting operation of the user in the field name setting area, and determining the field name of the target form field of the input control corresponding to the field setting control.
B. The configuration process of the data processing control is as follows: the data factory provides 5 data processing controls, which are core tools for processing data. The required data processing control is dragged to the data flow design area to be added, and a plurality of data processing controls can be added to one data flow.
Each data processing control has the following functions:
a. and (3) transversely connecting a control: and merging the data left and right of the two data forms into one form according to the connection field value. The lateral connection currently supports the following 3 connection modes:
left connection: corresponding to left join in the SQL statement;
right connection: corresponding to right join in the SQL statement;
and (3) internal connection: an inner join in the corresponding SQL statement;
in the case of transverse connection, the left and right data forms need to have a common form field, namely a connection field, and the data are combined according to the connection field in the case of connection. Referring to fig. 10, an adding flow interface diagram of a cross-connect control is shown, a cross-connect data processing space is added in a data flow design area, and then 2 input controls are sequentially connected to the cross-connect control.
The connection mode and the connection field of the lateral connection control need to be configured, please refer to fig. 11, which is a specific configuration interface diagram of the lateral connection control, and the connection mode and the connection field of the lateral connection control are configured. Referring to fig. 12, after the configuration of the data preview interface diagram after the lateral connection, clicking the data preview can check the connection condition of the data form.
b. Adding a merging control: fields of the same data type in a plurality of data tables are combined into one table.
The additional merging is mainly applied to data merging with almost the same data structure. Referring to fig. 13, in order to add a specific configuration interface diagram of an additional merging control, an additional merging data processing control is added in the data flow configuration interface, 2 data forms are respectively connected to the additional merging control, after connection, the system automatically merges the form fields with the same field name and the same field type into a column, and the form fields with different names need to be manually merged.
Referring to fig. 14, a flow chart of modification of the names of the combined form fields is shown, and modification of the names of the combined form fields is supported after additional combination. Clicking on the field name can quickly modify the name to another field name. Referring to fig. 15, to add the combined data preview interface diagram, the combined data supports direct drag ordering, and clicking the data preview can preview the combined effect.
c. Grouping summary control: and merging the same form fields in the data form into 1 group according to the set conditions, and then performing summarization calculation.
When grouping and summarizing, firstly, all form fields are classified according to groups, and then summarizing calculation is carried out on the form fields in the groups. The following 2 calculation modes are currently supported: count and deduplication count. Referring to fig. 16, an add flow interface diagram of a group summary control is shown, wherein a group summary data processing control is added to a data flow design area, and then a table is connected to the group summary control.
Referring to fig. 17, a configuration interface diagram of a packet field and a summary field is shown; the grouping field classifies the data according to which form field in the data forms, and the similar data is classified into a group during classification. One packet summary control supports adding multiple packet fields, with the added packet fields supporting deletion and renaming. The summary field is based on which form field to perform the summary calculation. One group summary control supports adding multiple summary fields, and the added summary fields support deletion, renaming and summary mode setting.
d. Data screening control: and adding screening conditions, filtering out useless data, and only retaining the data to be processed.
The data screening is used for data filtering, and data which does not need to be processed in the data form can be filtered, and only the data which needs to be processed is reserved. Referring to fig. 18, after an input table is added, dragging the data filtering control from the left side to the data flow design area, adding a connection line between the input table and the data filtering control, clicking the data filtering, i.e. clicking the data filtering in the control configuration to add a filtering condition, for example, the set filtering condition may be "please purchase quantity is greater than 200".
f. A field setting control: the field order may be adjusted, the control field display hidden, new calculation fields added.
And setting fields, namely displaying and hiding the input form fields, renaming the calculation fields and the like in a data factory. Referring to fig. 19, for a specific configuration interface diagram of a field setting control, a field setting data processing control is added in a data flow design area, then a table is connected to the field setting control, the field setting control is clicked, and the fields of the connection table are set.
It should be noted that, the user may select the required data processing controls according to the actual situation, sort the data processing controls according to a certain connection sequence, and then connect with the input controls one by one; the first data processing control part of the connection sequence is directly connected with the input control part, and the rest data processing control parts are indirectly connected with the output control part by being connected with the data processing control parts of the sequence before.
After the setting of the data processing control is completed, the platform completes data operation according to a specific algorithm according to five different data processing requests of transverse connection, additional combination, grouping summarization, data screening and field setting, wherein the related main algorithms include but are not limited to the following:
SUM algorithm: calculating a sum of one or more digits;
SUMIF algorithm: calculating the sum of numbers meeting specified conditions in a region;
AVERAGE algorithm: returning an average value of a set of data;
AVERAGEIF algorithm: returning an average value of values in the set of data that meet the specified condition;
COUNT algorithm: counting the number of digits in the designated area;
COUNTIF algorithm: counting the number of cells meeting the specified conditions in the specified cell area;
MAX algorithm: returning a maximum value in a set of data;
MAXIFS algorithm: returning a maximum value in the set of data that meets one or more specified conditions;
MIN algorithm: returning a minimum value in the set of data;
MINIFS algorithm: returning a minimum value in the set of data that meets one or more specified conditions;
ADDRESS algorithm: returning the representative cell reference in a text format according to the provided row number and column number parameters;
AREAS algorithm: returning the number of regions in the reference;
the CHOOSE algorithm: returning a value of the corresponding position from a set of data according to the index position parameter;
COLUMN algorithm: returning a column number of the cell reference;
COLUMNS algorithm: returning the column number of the cell area references or arrays;
HLOOKUP algorithm: searching the designated numerical value in the first row in the table, and returning the numerical value of the designated row in the column;
LOOKUP algorithm (array form): searching a designated value from the first row or the first column of the provided array, and returning the value at the same position in the last row or the last column of the array;
MATCH algorithm: searching a designated value from the provided cell area, and returning the relative position of the designated value in the cell area;
OFFSET algorithm: calculating from the initial position according to the specified row offset and column offset, and returning to the cell or cell region of the specified offset;
VLOOKUP algorithm: the designated search value is searched for in the first column of the designated cell region, and the value of the designated column in the row is returned.
S5, when the existence of an output control in the data flow design area is detected, determining the table name of a data output table to be generated;
C. the configuration process of the output control is as follows, the output control is used for storing the processed data. Generally, we set names for output controls to distinguish between different data output tables. Referring to fig. 20, in order to configure an interface diagram of an output control specifically, an output control is dragged to a data flow design area to be added, the output control is clicked, and a data table is output after the data flow calculation. After a data output table is obtained, the data is synchronized to the table, a data stream can be newly built to process the data of the data output table again, and a new data table is obtained.
Through the steps, the design of data stream configuration is basically completed, and finally, the name is set for the data stream and the data stream is clicked for storage.
And S6, processing the data to be processed according to the data processing sequence corresponding to each processing mode to generate processed data, and then generating a data output table according to the processed data and the table name.
The data output table can be obtained after the service data processing, the system reference schedule data can be combined, the existing service operation rules or the customized operation rules can be selected to automatically generate the corresponding service results, the management decision under the supply chain scene of the supporting ship sea enterprise is made, the service operation rules related to the current system mainly comprise the material receiving period march rolling schedule operation, and the operation steps are as follows:
step 1: generating a corresponding material three-month receiving period plan according to the imported production three-month rolling plan and the design tray list, and generating a unique material identification code for each material;
step 2: and generating a completion time node of the corresponding node according to plan key milestone nodes (demand application, poll price, price examination, contract examination and approval, contract signing, material production, material delivery, material arrival, material receiving reservation and the like) and calculation rules of the plan key milestone nodes which are pre-configured according to the operation rules of the material receiving period March rolling plan.
step 3: and combining the service output data after pretreatment processing to generate a current material receiving period March rolling plan and a finishing condition thereof.
When a new service operation rule is needed, a calculation reference schedule is selected firstly, then corresponding key milestone nodes are configured, and a data operation rule is set up according to each milestone node so as to realize automatic calculation of the nodes.
Preferably, the method for processing ship service data further comprises: responding to an aggregation table creation instruction of a user, and generating an aggregation table configuration interface; wherein the aggregate table configuration interface comprises: a name setting area, a data source selection area, a row header setting area and an aggregation index setting area; determining a table name of the aggregation table in response to a name setting operation acting in the name setting area; responding to data source selection operation acted in the data source selection area, and acquiring a data form to be aggregated; determining header fields of the aggregate table in response to a row header setting operation acting on the row header setting area; determining an aggregation indicator of the aggregation table in response to an aggregation indicator setting acting within the aggregation indicator setting area; and carrying out data aggregation on the data forms to be aggregated according to the aggregation index to generate aggregation data, and then generating an aggregation output table according to the aggregation data, the table names of the aggregation tables and the table header fields of the aggregation tables.
Preferably, the data source selection area further comprises: setting a sub-region for the filtering condition; after the data form to be aggregated is acquired, the method further comprises: when the filtering condition setting operation exists in the filtering condition setting subarea, determining the filtering condition of the data form to be aggregated; and eliminating the form fields which do not meet the filtering conditions in the data forms to be aggregated.
Preferably, after the acquiring the data form to be aggregated, the method further includes: when the data forms to be aggregated contain a plurality of data forms, identifying field names of the form fields in each data form to be aggregated, and merging the form fields with the same field names in each data form to be aggregated.
In the processing method of ship service data, the invention also provides a data processing method of data aggregation, besides performing data processing on the ship service data in a data factory in a data stream form, wherein the specific data aggregation flow is as follows:
the data aggregation table includes:
(1) Naming the aggregation table, clicking the upper left corner after creating the aggregation table to rename the aggregation table;
(2) The data source is directly selected if the data source is a single data form; if the multi-table association is performed, an association field is required to be set after the data table is selected;
(3) The filtering conditions are set, invalid data can be removed and then calculated, and accuracy and effectiveness of preprocessing data calculation are guaranteed;
(4) The column header, namely the beginning of each column in the aggregation table, the fields of the column header are longitudinally arranged at the leftmost side, and the values of the corresponding tables are transversely arranged;
(5) The index temporarily only supports summary indexes, and operators in the summary indexes only support addition and subtraction among fields.
Referring to fig. 21, an overall data processing flow chart of data aggregation is shown, where the overall data processing flow chart relies on an aggregation table to implement landing, and a specific operation flow is as follows:
(1) Polymerization table naming: referring to fig. 22, a schematic diagram of an aggregation table creation interface is shown, entering an aggregation table page, clicking the upper right corner to create an aggregation table. Referring to fig. 23, a schematic diagram of an aggregate table name configuration interface is shown, and the aggregate table name configuration interface enters an aggregate table design page, sets configuration such as names, and returns to the aggregate table page after being stored.
(2) Data sources: referring to fig. 24, a schematic diagram of an aggregate table data source selection interface is shown, entering a setup page of an aggregate table first requires setting a data source, if the data source is from a single data table, it may be selected from the list data, and if the data source is from multiple data tables, i.e. the data source table is selected from multiple table associations.
If the data is single-table data, the data is directly selected; in the case of multi-table associations, the form field needs to be selected to establish the association after the data form has been selected. Referring to fig. 25, a schematic diagram of a multi-table association configuration interface is shown, the same contents of the table fields in the multiple data tables are found, and the multiple data tables are connected together according to the same contents of the table fields to form a piece of data.
(3) Filtration conditions: referring to fig. 26, an interface is set for the data filtering conditions, so that invalid data participating in the calculation of the aggregation table can be removed by setting the filtering conditions, and only the filtered data is calculated, thereby ensuring the accuracy and effectiveness of the calculation of the preprocessed data.
(4) List head: the content of the form field to be presented can be added to the aggregate table, i.e., the data is summarized by row header. Referring to fig. 27, a schematic diagram of a configuration interface of a header is shown, where the name of the header may be modified by user-defining at a corresponding location:
(5) The index is as follows: the data obtained after the form fields in the data form are subjected to addition and subtraction operation is indicated, the index only supports the summary index at present, operators in the summary index only support the addition and subtraction between the form fields, and the index only can add digital fields. Referring to fig. 28, a summary index configuration interface is shown, and a new index is clicked to add the summary index, and after the summary index is stored, a summary table appears, so that data aggregation is completed, and an aggregate output table is generated.
In a data factory, a configurable flow form is dragged, assembled and configured through visual programming, service data in a supply chain management scene facing to the ship industry is rapidly processed, a data source is firstly configured through dragging an input control, then a transverse connection control, an additional merging control, a grouping summarizing control, a data screening control or a field setting control are dragged and connected with a data stream, a data processing method is configured, finally, a data output control is dragged and connected with the data stream, a data table is output, and the data form is synchronized to a supply chain management system for calling. In the aggregation table, the existing form data is pre-calculated (pre-processed) for further calling, and the aggregation table is output according to the steps of naming the aggregation table, setting data sources, setting filtering conditions, modifying the line table header and adding the aggregation index in sequence, so that the calling of the supply chain management system is met.
Therefore, compared with the mode of integrating and processing ship service data manually in the prior art, the method provided by the invention has the advantages that the connection relation between all editing controls dragged to the data stream design area by a user and all controls is determined, the data stream is configured according to the connection relation between all editing controls and all controls, then the data to be processed is processed through the configured data stream, the processing of the service data in the supply chain management system can be automatically performed, the processing efficiency of the service data is improved, and the level of collaborative management among enterprises is enhanced.
Example two
Referring to fig. 29, a schematic structural diagram of a processing device for ship service data according to an embodiment of the present invention is provided, where the device includes: the system comprises a data stream configuration interface generation module, an editing control determination module, a data acquisition module to be processed, a data determination module to be processed, a table name determination module and a data output table generation module;
the data stream configuration interface generation module is used for generating a data stream configuration interface; wherein the data flow configuration interface comprises: editing a control selected area and a data stream design area; the editing control comprises: the device comprises an input control for acquiring data to be processed, an output control for storing the processed data and a data processing control for indicating a data processing mode;
The editing control determining module is used for detecting the editing controls dragged from the selected area of the editing control to the data flow design area by the user and determining all the editing controls dragged to the data flow design area by the user and the connection relation among all the controls;
the data to be processed acquisition module is used for acquiring data to be processed corresponding to an input control when the input control exists in the data flow design area;
the data to be processed determining module is used for determining a data processing mode corresponding to data to be processed and a data processing sequence corresponding to each data processing mode when detecting that a data processing control exists in the data flow design area;
the table name determining module is used for determining the table name of the data output table to be generated when the output control exists in the data flow design area;
the data output table generating module is used for processing the data to be processed according to the data processing sequence corresponding to each processing mode to generate processed data, and then generating a data output table according to the processed data and the table name.
Example III
Accordingly, an embodiment of the present invention provides a processing device for ship service data, where the device includes a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, where the processor implements the processing method for ship service data according to the embodiment of the present invention when executing the computer program.
Example IV
Accordingly, an embodiment of the present invention provides a storage medium, where the storage medium includes a stored computer program, where when the computer program runs, a device where the storage medium is controlled to execute the method for processing ship service data according to the embodiment of the present invention.
In summary, compared with the mode of integrating and processing ship service data manually in the prior art, the processing device, the device and the storage medium for processing ship service data provided by the invention have the advantages that through determining the connection relation between each editing control dragged to a data stream design area by a user and each control, the data stream is configured according to the connection relation between each editing control and each control, and then the data to be processed is processed through the configured data stream, so that the processing efficiency of the service data in a supply chain management system can be improved, and the level of collaborative management among enterprises can be enhanced.
It should be noted that the above-described apparatus embodiments are merely illustrative, and the units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed over a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. In addition, in the drawings of the embodiment of the device provided by the invention, the connection relation between the modules represents that the modules have communication connection, and can be specifically implemented as one or more communication buses or signal lines. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
It will be clearly understood by those skilled in the art that, for convenience and brevity, the specific working process of the apparatus described above may refer to the corresponding process in the foregoing method embodiment, which is not described herein again.
The device may be a computing device such as a desktop computer, a notebook, a palm computer, a cloud server, etc. The device may include, but is not limited to, a processor, a memory.
The processor may be a central processing unit (Central Processing Unit, CPU), other general purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), off-the-shelf programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like that is a control center of the device, connecting the various parts of the overall device using various interfaces and lines.
The memory may be used to store the computer program, and the processor may implement various functions of the device by running or executing the computer program stored in the memory, and invoking data stored in the memory. The memory may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function, and the like; the storage data area may store data created according to the use of the cellular phone, etc. In addition, the memory may include high-speed random access memory, and may also include non-volatile memory, such as a hard disk, memory, plug-in hard disk, smart Media Card (SMC), secure Digital (SD) Card, flash Card (Flash Card), at least one disk storage device, flash memory device, or other volatile solid-state storage device.
The storage medium is a computer readable storage medium, and the computer program is stored in the computer readable storage medium, and when executed by a processor, the computer program can implement the steps of the above-mentioned method embodiments. Wherein the computer program comprises computer program code which may be in source code form, object code form, executable file or some intermediate form etc. The computer readable medium may include: any entity or device capable of carrying the computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer Memory, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), an electrical carrier signal, a telecommunications signal, a software distribution medium, and so forth. It should be noted that the computer readable medium contains content that can be appropriately scaled according to the requirements of jurisdictions in which such content is subject to legislation and patent practice, such as in certain jurisdictions in which such content is subject to legislation and patent practice, the computer readable medium does not include electrical carrier signals and telecommunication signals.
While the foregoing is directed to the preferred embodiments of the present invention, it will be appreciated by those skilled in the art that changes and modifications may be made without departing from the principles of the invention, such changes and modifications are also intended to be within the scope of the invention.