Disclosure of Invention
In view of the foregoing, it is desirable to provide a relational database-based data processing method, apparatus, computer device, computer-readable storage medium, and computer program product that can improve the flexibility of relational database data processing.
In a first aspect, the present application provides a data processing method based on a relational database, including:
acquiring data to be processed and starting instruction information, and starting a target processing task according to the starting instruction information, wherein the starting instruction information is generated based on starting condition triggering information of the target processing task and ending instruction information of a previous period;
Acquiring dependency relationship information between the target processing task and the target associated task;
Executing the target processing task according to the data to be processed, generating ending instruction information of a period, and generating starting condition triggering information of the target associated task according to the dependency information so as to trigger starting of the target associated task and the target processing task of the next period.
In one embodiment, the data to be processed includes the necessary data and the unnecessary data, the acquiring the data to be processed and the starting instruction information, and starting the target processing task according to the starting instruction information includes:
Acquiring the data to be processed;
Generating starting instruction information according to starting condition triggering information of the target processing task and ending instruction information of the last period under the condition that the data to be processed is the necessary data and the necessary data is obtained completely, and starting the target processing task according to the starting instruction information;
acquiring a starting configuration table under the condition that the data to be processed is unnecessary data;
Generating starting instruction information according to the starting conditions in the starting configuration table, the starting condition triggering information of the target processing task and the ending instruction information of the last period, and starting the target processing task according to the starting instruction information.
In one embodiment, the generating the start instruction information according to the start condition in the start configuration table, the start condition trigger information of the target processing task, and the end instruction information of the previous cycle includes:
Determining the starting time of the target processing task according to the starting configuration table;
And under the condition that the starting time arrives, generating starting instruction information according to the starting condition triggering information of the target processing task and ending instruction information of the last period.
In one embodiment, the unnecessary data further includes delayed start data, and the generating start instruction information according to the start condition trigger information of the target processing task and the end instruction information of the last period includes:
When the unnecessary data is the delay starting data, determining starting time and preset waiting time of the target processing task according to the starting configuration table;
Under the condition that the starting time arrives and the delayed starting data is obtained completely, starting instruction information is generated according to starting condition triggering information of the target processing task and ending instruction information of the previous period;
when the starting time arrives and the delayed starting data acquisition is incomplete, starting to count the waiting time;
And under the condition that the waiting time is equal to the preset waiting time or the delayed starting data acquisition is complete, starting instruction information is generated according to the starting condition triggering information of the target processing task and ending instruction information of the last period.
In one embodiment, the obtaining the data to be processed and the start instruction information includes:
and responding to the total starting instruction of the current working area, and acquiring data to be processed and starting instruction information.
In one embodiment, the target processing task and the target associated task belong to the same or different working areas, the executing the target processing task according to the data to be processed generates ending instruction information of a period, and generating starting condition triggering information of the target associated task according to the dependency information to trigger starting the target associated task and the target processing task of a next period, including:
executing the target processing task according to the data to be processed, and generating ending instruction information of the period;
Responding to a total starting instruction of the current working area in the next period to trigger starting of the target processing task in the next period;
generating starting condition triggering information of the target associated task according to the dependency information;
And responding to a total starting instruction of a working area to which the target associated task belongs, so as to trigger starting the target associated task.
In a second aspect, the present application also provides a data processing apparatus based on a relational database, including:
the information acquisition module is used for acquiring data to be processed and starting instruction information, and starting a target processing task according to the starting instruction information, wherein the starting instruction information is generated based on starting condition triggering information of the target processing task and ending instruction information of a previous period;
the relation acquisition module is used for acquiring dependency relation information between the target processing task and the target association task;
The data processing module is used for executing the target processing task according to the data to be processed, generating ending instruction information of a period, and generating starting condition triggering information of the target associated task according to the dependency relationship information so as to trigger the starting of the target associated task and the target processing task of the next period.
In a third aspect, the present application also provides a computer device comprising a memory and a processor, the memory storing a computer program, the processor implementing the following steps when executing the computer program:
acquiring data to be processed and starting instruction information, and starting a target processing task according to the starting instruction information, wherein the starting instruction information is generated based on starting condition triggering information of the target processing task and ending instruction information of a previous period;
Acquiring dependency relationship information between the target processing task and the target associated task;
Executing the target processing task according to the data to be processed, generating ending instruction information of a period, and generating starting condition triggering information of the target associated task according to the dependency information so as to trigger starting of the target associated task and the target processing task of the next period.
In a fourth aspect, the present application also provides a computer readable storage medium having stored thereon a computer program which when executed by a processor performs the steps of:
acquiring data to be processed and starting instruction information, and starting a target processing task according to the starting instruction information, wherein the starting instruction information is generated based on starting condition triggering information of the target processing task and ending instruction information of a previous period;
Acquiring dependency relationship information between the target processing task and the target associated task;
Executing the target processing task according to the data to be processed, generating ending instruction information of a period, and generating starting condition triggering information of the target associated task according to the dependency information so as to trigger starting of the target associated task and the target processing task of the next period.
In a fifth aspect, the application also provides a computer program product comprising a computer program which, when executed by a processor, performs the steps of:
acquiring data to be processed and starting instruction information, and starting a target processing task according to the starting instruction information, wherein the starting instruction information is generated based on starting condition triggering information of the target processing task and ending instruction information of a previous period;
Acquiring dependency relationship information between the target processing task and the target associated task;
Executing the target processing task according to the data to be processed, generating ending instruction information of a period, and generating starting condition triggering information of the target associated task according to the dependency information so as to trigger starting of the target associated task and the target processing task of the next period.
The above-described relational database-based data processing method, apparatus, computer device, storage medium, and computer program product, by acquiring data to be processed and startup instruction information, startup a target processing task according to the startup instruction information, since the startup instruction information is generated based on startup condition trigger information of the target processing task and end instruction information of a previous cycle, the startup instruction information depends on the end instruction information of the previous cycle, and on startup condition trigger information from a target associated task, the method comprises the steps of setting clear dependence and association relation between different tasks, guaranteeing data consistency, executing target processing tasks according to-be-processed data by acquiring dependence relation information between the target processing tasks and the target association tasks, generating ending instruction information of a period, generating starting condition triggering information of the target association tasks according to the dependence relation information, triggering the starting target association tasks and the target processing tasks of the next period, processing the to-be-processed data according to flexible dependence relation, and improving data processing flexibility of a relational database.
Detailed Description
The present application will be described in further detail with reference to the drawings and examples, in order to make the objects, technical solutions and advantages of the present application more apparent. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the application.
The data processing method based on the relational database provided by the embodiment of the application can be applied to an application environment shown in figure 1. The terminal 102 communicates with the server 104 through a network, and the terminal 102 may be configured to acquire data to be processed and send the data to be processed to the server 104 for processing. The data storage system may store data that the server 104 needs to process. The data storage system may be integrated on the server 104 or may be located on a cloud or other network server. The data storage system can be used for storing data to be processed which is not processed yet, preset data such as dependency relationship information between a target processing task and a target associated task, and the like, and can also be used for recording starting instruction information, ending instruction information, starting condition triggering information and the like. The terminal 102 may be, but not limited to, various personal computers, notebook computers, smart phones, tablet computers, internet of things devices, and portable wearable devices, where the internet of things devices may be smart speakers, smart televisions, smart air conditioners, smart vehicle devices, and the like. The portable wearable device may be a smart watch, smart bracelet, headset, or the like. The server 104 may be implemented as a stand-alone server or as a server cluster of multiple servers.
In an exemplary embodiment, as shown in FIG. 2, a relational database-based data processing method is provided, the relational database (Relational Database) being a relational model-based database management system, data being stored in the form of tables, each table consisting of rows and columns. Each row represents a data record and each column represents a field or data attribute. In relational databases, there is typically some relationship between data that is established by a Foreign Key (Foreign Key). The relational database management system may employ a structured query language to perform data management and operations such as insertion, query, update, and deletion. Taking the server 104 in fig. 1 as an example, the method is applied to the following steps S202 to S206. Wherein:
Step S202, data to be processed and starting instruction information are obtained, and a target processing task is started according to the starting instruction information.
Wherein the data to be processed includes the must-to-data and the not-to-data. Where must-come data refers to data from must-come data sources and not must-come data refers to data from not must-come data sources. The necessary data source is the data source which is required to be reached at the appointed moment in the data and a small amount of service demands of the core system, if the necessary data source is not in place in time, the task cannot be started or cannot be completed smoothly, such as real-time data, data in a key database and the like, and the method is used for processing strategy input variables with higher data timeliness and accuracy requirements. The task execution may begin without the need for data sources having less impact on task execution, which may be in addition to the data sources that the core system and business specifies are necessary, data sources that may use historical up-to-date data, and may be supplemental or auxiliary data, such as historical data, secondary information, etc., for processing policy input variables that require relatively low aging requirements.
The starting instruction information is generated based on starting condition triggering information of the target processing task and ending instruction information of the last period.
For example, the server 104 may obtain data to be processed and start instruction information from the terminal 102 or other servers. The data to be processed includes two types, must-to-data and not must-to-data. The data must be core data that the task must rely on to perform, e.g., an order processing task may need to rely on real-time inventory data and customer order data that must be prepared before the task can begin. While not necessarily auxiliary data, although helpful to task execution, need not be fully prepared prior to the task beginning, such as historical sales data or market trend data. Server 104 may determine whether the current task may be started based on the end state of the last periodic task. And generating end instruction information when the processing period of the data analysis task of the previous period is ended, indicating the start of the next analysis period, wherein the end instruction information is used as one of starting conditions, and ensuring that the starting time of the new task is correct.
The server 104 may obtain data to be processed, generate start instruction information according to start condition trigger information of a target processing task and end instruction information of a previous period when the data to be processed is data and the data to be processed is obtained completely, and start the target processing task according to the start instruction information, obtain a start configuration table when the data to be processed is data which is not necessary, generate start instruction information according to start conditions in the start configuration table, and start condition trigger information of the target processing task and end instruction information of the previous period, and start the target processing task according to the start instruction information.
Further, the server 104 may set a strong dependency on the necessary data, and if the data to be processed is the necessary data, and the data is already completely acquired, the server 104 may generate the start instruction according to the start condition trigger information of the target processing task and the end instruction information of the last cycle. If, for example, a data cleansing task of one cycle has been completed and end instruction information is generated, server 104 may generate new start instruction information based on the end instruction information and the start condition of the current target task (e.g., data requiring a particular date range). The generated start instruction information will instruct the server to start a target processing task, such as a data aggregation or data analysis task.
On the other hand, the server 104 may avoid setting a strong dependency on unnecessary data, and if the data to be processed is unnecessary data, the server 104 may not directly depend on the integrity of the data to determine whether the task is started. At this point, the server 104 may obtain a startup configuration table. The starting configuration table is a table for storing task execution configuration and dependency relationship, and contains information such as starting conditions, priorities, dependent unnecessary data types, task execution timetables and the like of different tasks. For example, the starting configuration table may include that the starting condition of a certain task is an end instruction of a data cleaning task and part of data of the data source a, and part of data of the data source B may be acquired gradually during the task execution process.
Next, the server 104 may generate a new start instruction by reading the information in the start configuration table, in combination with the start condition trigger information of the target processing task and the end instruction information of the previous cycle. For example, assuming that a data cleansing task has been completed, starting a configuration table indicates that a certain data aggregation task depends on the end instruction of the data cleansing task, and that unnecessary data (e.g., historical order information) to be acquired may be loaded step by step during execution of the task. Even if these unnecessary data are not completely ready, the server 104 may still generate startup instructions from the startup configuration table and start the target processing task.
Further, assume that server 104 is currently responsible for processing data for inventory of goods. In this process, there are two target tasks, "inventory data analysis" and "inventory data update". The inventory data analysis task relies on the current day's inventory data and sales data (must be data), while the inventory data update task relies on only a portion of the historical inventory data (not must be data). If the inventory data analysis task has completed and an end instruction is generated, the server 104 may initiate an inventory data update task based on the information in the start configuration table. At this time, even if part of the historical inventory data is not fully prepared, the system starts the task and dynamically acquires the remaining data during execution as long as the task is allowed to execute in the configuration table when the data is not fully in place.
Further, the server 104 may further determine a starting time of the target processing task according to the starting configuration table, and generate starting instruction information according to starting condition triggering information of the target processing task and ending instruction information of a previous period when the starting time arrives.
Illustratively, the launch configuration table contains not only the launch conditions of the tasks, but also defines a predetermined launch time and execution order for each task. For example, the start configuration table may specify that a "inventory data update" task should start at 2 a.m. every day, or it may rely on some data cleansing tasks to begin execution after completion at 10 a.m. The server 104 may determine the starting time of the task according to the time point defined in the configuration table.
For example, the server 104 may obtain the data to be processed and the startup instruction information in response to the total startup instruction of the current workspace. Server 104 may set a total start command for the data processing system, and the start node of each working area should rely on the total start command to achieve the overall control effect of starting and ending the current batch.
Step S204, obtaining the dependency relationship information between the target processing task and the target associated task.
The target processing task and the target association task may belong to the same working area or may belong to different working areas. The task to be processed of each working area can start the processing task according to the total starting instruction, and the tasks to be processed of different working areas can be related to each other through the dependency relationship information, so that the dependency of the tasks across the working areas is realized. The dependency information may be a table structure of a data warehouse, a table of data or signals generated by tasks, or the like.
The server 104 may illustratively obtain dependency information between tasks by accessing the corresponding data storage system. The dependency information is used to characterize the execution order between different tasks. For example, the target processing task is "data cleansing", and the target associated task is "data analysis". The data cleansing task must be completed before the data analysis task can begin. Thus, the server 104 needs to know the relationship of the two tasks and ensure that the analysis task is started after the cleaning task is completed.
Step S206, executing the target processing task according to the data to be processed, generating end instruction information of the period, and generating starting condition triggering information of the target associated task according to the dependency information so as to trigger the starting of the target associated task and the target processing task of the next period.
The server 104 may execute the target processing task according to the data to be processed to generate end instruction information of the current period, respond to a total start instruction of a current working area of the next period to trigger starting the target processing task of the next period, generate starting condition trigger information of the target associated task according to the dependency relationship information, and respond to the total start instruction of the working area to which the target associated task belongs to trigger starting the target associated task.
Further, first, the server 104 may perform a target processing task according to the data to be processed. For example, if the data to be processed is ready and meets the start conditions of the target task, the server 104 may start the target processing task, such as data cleansing, data analysis, or other data processing tasks. After completion of task execution, server 104 may generate end instruction information for the current cycle to indicate that the task for the current cycle has completed and provide the necessary starting conditions for the task for the next cycle.
Next, in response to the total start instruction of the current working area of the next cycle, the server 104 may start the target processing task of the next cycle, and the server 104 may check the dependency information of all tasks in the current working area, and start the corresponding task according to the dependency information. Meanwhile, the server 104 may generate the trigger information of the start condition of the target associated task according to the dependency information. Server 104 may determine when the target associated task should be started based on the dependency information and generate corresponding start condition trigger information. Then, in response to the total launch instruction of the workspace to which the target associated task belongs, the server 104 may trigger the launch of the target associated task.
In the data processing method based on the relational database, the target processing task is started according to the starting instruction information by acquiring the data to be processed and the starting instruction information, and the starting instruction information is generated based on the starting condition triggering information of the target processing task and the ending instruction information of the last period, so that the starting instruction information depends on the ending instruction information of the last period and depends on the starting condition triggering information from the target associated task, clear dependence and association relation among different tasks are set, data consistency is ensured, the target processing task is executed according to the data to be processed by acquiring the dependence relation information between the target processing task and the target associated task, the ending instruction information of the period is generated, and the starting condition triggering information of the target associated task is generated according to the dependence relation information, so that the target associated task is started and the target processing task of the next period are triggered, the data to be processed according to the flexible dependence relation, and the data processing flexibility of the relational database is improved.
In an exemplary embodiment, to implement the above steps, the server 104 may divide the data into four layers, that is, a storage layer, a base layer, a middle layer, and an output layer, so as to ensure traceability of the data, effectively implement multiplexing of the data, and ensure consistency control of the data source in the multitasking process.
Wherein the server 104 may record date information used by the various data sources by starting the configuration table at the storage layer without directly storing the actual data. The server 104 can process and process corresponding data in the base layer according to the data source date provided by the storage layer and combining the dependency information, the server 104 can also respectively generate a core data table, a non-core data table and a core and non-core related table in the middle layer according to different service dimensions (such as clients, accounts, bills and the like), further process and classify the base data, extract a multi-dimensional data view and display the multi-dimensional data view in the terminal 102 to meet different analysis requirements, and the server 104 can classify and combine various tables in the middle layer in the output layer to finally produce a result table meeting the service requirements and display the result table in the terminal 102.
Through the hierarchical data architecture, transparent and traceable processing of data in each stage can be ensured, and meanwhile, through reasonable division and layering processing, consistency of data sources and efficient utilization of storage space are ensured.
In an exemplary embodiment, as shown in fig. 3, the unnecessary data may further include delayed start data, and the step of generating start instruction information according to start condition trigger information of the target processing task and end instruction information of the previous cycle may include steps S302 to S308. Wherein:
in step S302, in the case that the unnecessary data is delay start data, the start time and the preset waiting time of the target processing task are determined according to the start configuration table.
The delayed start data refers to data from specific unnecessary data sources, which are used for processing policy input variables of a specific service scenario designated by a demand provider, and the data sources do not belong to an essential part of a core task, but have higher timeliness requirements, so that the server 104 can set a latest waiting time, namely preset waiting time, and after reaching the designated waiting time, start to execute related tasks, so that timeliness of the data is ensured, and meanwhile, execution time sequence of the key tasks is not influenced.
For example, in the case where the unnecessary data is delay start data, the server 104 may confirm the start time of the target processing task according to the start configuration table, and obtain the preset waiting time period by searching the start configuration table or by accessing the data storage system according to the data tag of the delay start data. For example, assuming that the payment status of a certain order data source needs to be in place within a certain time limit to ensure timely processing, a preset waiting period, such as 6 hours, may be defined in the start configuration table, which indicates that if the data is not in place within 6 hours, the task will start after 6 hours, regardless of whether the data is completely in place.
Step S304, under the condition that the starting time arrives and the delayed starting data acquisition is complete, starting instruction information is generated according to the starting condition triggering information of the target processing task and the ending instruction information of the last period.
For example, after the start-up time arrives, the server 104 may check whether the delayed start-up data has been obtained intact. If the data is already in place, the server 104 will generate a start instruction according to the start condition trigger information of the target processing task and the end instruction information of the last cycle, so as to start the target processing task.
Step S306, when the starting time arrives and the delayed starting data acquisition is incomplete, starting to count the waiting time.
For example, after the start-up time arrives, the server 104 may check whether the delayed start-up data has been obtained intact. If the delayed start data is not yet obtained completely, the server 104 may invoke the timing task to start timing, enter a waiting stage, and wait for the data to be in place according to a preset waiting duration. At this stage, the task does not start immediately, but rather continues to wait for the data source to be in place.
Step S308, under the condition that the waiting time is equal to the preset waiting time or the delayed starting data acquisition is complete, starting instruction information is generated according to the starting condition triggering information of the target processing task and the ending instruction information of the last period.
For example, when the waiting duration reaches the preset waiting duration, or the delayed start data is completely acquired during the waiting process, the server 104 may recheck the data integrity, and generate the start instruction information according to the start condition trigger information of the target processing task and the end instruction information of the last cycle. At this time, whether the data is completely acquired or not, as long as the waiting time is full, the server 104 generates a start instruction and starts related tasks on time, so that the time delay for starting the data processing can take account of the timeliness of the data and the flexibility of the tasks, and the key path of the whole batch processing is not influenced even if the non-core data source is delayed, thereby guaranteeing the data processing efficiency and the service continuity.
In another exemplary embodiment, the server 104 obtains start instruction information in response to a total start instruction of the current workspace, and starts the target processing task according to the start instruction information, wherein the start instruction information is generated based on start condition trigger information of the target processing task and end instruction information of a previous cycle.
Meanwhile, the server 104 acquires data to be processed, generates starting instruction information according to starting condition trigger information of a target processing task and ending instruction information of a previous period under the condition that the data to be processed is the necessary data and the necessary data acquisition is complete, and starts the target processing task according to the starting instruction information. When the data to be processed is unnecessary data, the server 104 acquires a start configuration table, determines the start time of the target processing task according to the start configuration table, generates start instruction information according to start condition trigger information of the target processing task and end instruction information of the previous period when the start time arrives, and starts the target processing task according to the start instruction information.
When the data is not necessary to be delay starting data, the server 104 determines starting time and preset waiting time of the target processing task according to the starting configuration table, generates starting instruction information according to starting condition triggering information of the target processing task and ending instruction information of the last period when the starting time arrives and delay starting data is complete, starts timing waiting time when the starting time arrives and delay starting data is incomplete, and generates starting instruction information according to the starting condition triggering information of the target processing task and ending instruction information of the last period when the waiting time is equal to the preset waiting time or delay starting data is complete.
Next, the server 104 obtains dependency information between the target processing task and the target associated task, executes the target processing task according to the data to be processed, generates end instruction information of the current period, responds to a total starting instruction of the current working area of the next period to trigger starting of the target processing task of the next period, and the server 104 generates starting condition triggering information of the target associated task according to the dependency information, responds to the total starting instruction of the working area to which the target associated task belongs to trigger starting of the target associated task.
It should be understood that, although the steps in the flowcharts related to the embodiments described above are sequentially shown as indicated by arrows, these steps are not necessarily sequentially performed in the order indicated by the arrows. The steps are not strictly limited to the order of execution unless explicitly recited herein, and the steps may be executed in other orders. Moreover, at least some of the steps in the flowcharts described in the above embodiments may include a plurality of steps or a plurality of stages, which are not necessarily performed at the same time, but may be performed at different times, and the order of the steps or stages is not necessarily performed sequentially, but may be performed alternately or alternately with at least some of the other steps or stages.
Based on the same inventive concept, the embodiment of the application also provides a relational database-based data processing device for realizing the relational database-based data processing method. The implementation of the solution provided by the device is similar to the implementation described in the above method, so the specific limitation in the embodiments of the data processing device based on the relational database provided below may be referred to the limitation of the data processing method based on the relational database hereinabove, and will not be repeated here.
In one exemplary embodiment, as shown in FIG. 4, a relational database-based data processing apparatus is provided, comprising an information acquisition module 402, a relational acquisition module 404, and a data processing module 406, wherein:
the information acquisition module 402 is configured to acquire data to be processed and start instruction information, and start a target processing task according to the start instruction information, where the start instruction information is generated based on start condition trigger information of the target processing task and end instruction information of a previous period;
A relationship obtaining module 404, configured to obtain dependency relationship information between a target processing task and a target association task;
The data processing module 406 is configured to execute a target processing task according to the data to be processed, generate end instruction information of a current cycle, and generate starting condition triggering information of a target associated task according to the dependency information, so as to trigger starting of the target associated task and a target processing task of a next cycle.
In one embodiment, the data to be processed includes both must-to-data and not must-to-data, and the information acquisition module 402 includes:
The data acquisition unit is used for acquiring data to be processed;
The first acquisition unit is used for generating starting instruction information according to starting condition triggering information of the target processing task and ending instruction information of the last period under the condition that the data to be processed is the necessary data and the necessary data is acquired completely, and starting the target processing task according to the starting instruction information;
and the second acquisition unit is used for acquiring a starting configuration table under the condition that the data to be processed is unnecessary data, generating starting instruction information according to starting conditions in the starting configuration table, starting condition triggering information of the target processing task and ending instruction information of the last period, and starting the target processing task according to the starting instruction information.
In one embodiment, the second obtaining unit is further configured to determine a starting time of the target processing task according to the starting configuration table, and generate starting instruction information according to starting condition trigger information of the target processing task and ending instruction information of a previous period when the starting time arrives.
In one embodiment, the unnecessary data further includes delay initiation data, and the second acquisition unit includes:
The delay acquisition unit is used for determining the starting time and the preset waiting time of the target processing task according to the starting configuration table under the condition that the data are unnecessary to be the delay starting data;
The timing unit is used for generating starting instruction information according to starting condition trigger information of the target processing task and ending instruction information of the previous period when the starting time arrives and delay starting data acquisition is complete;
The information processing unit is also used for generating starting instruction information according to the starting condition triggering information of the target processing task and ending instruction information of the last period under the condition that the waiting time is equal to the preset waiting time or the delayed starting data acquisition is complete.
In one embodiment, the information obtaining module 402 is further configured to obtain the data to be processed and the start instruction information in response to a total start instruction of the current working area.
In one embodiment, the target processing task and the target associated task belong to the same or different working areas, the data processing module 406 is specifically configured to execute the target processing task according to the data to be processed, generate ending instruction information of the current working area of the next period, respond to a total starting instruction of the current working area of the next period to trigger and start the target processing task of the next period, generate starting condition triggering information of the target associated task according to the dependency relationship information, and respond to the total starting instruction of the working area to which the target associated task belongs to trigger and start the target associated task.
The respective modules in the relational database-based data processing device described above may be implemented in whole or in part by software, hardware, and combinations thereof. The above modules may be embedded in hardware or may be independent of a processor in the computer device, or may be stored in software in a memory in the computer device, so that the processor may call and execute operations corresponding to the above modules.
In one exemplary embodiment, a computer device is provided, which may be a server, the internal structure of which may be as shown in fig. 5. The computer device includes a processor, a memory, an Input/Output interface (I/O) and a communication interface. The processor, the memory and the input/output interface are connected through a system bus, and the communication interface is connected to the system bus through the input/output interface. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, computer programs, and a database. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The database of the computer equipment is used for storing data to be processed which is not processed yet, preset data such as dependency relationship information between a target processing task and a target associated task, and the like, and can also be used for recording data such as starting instruction information, ending instruction information, starting condition triggering information and the like. The input/output interface of the computer device is used to exchange information between the processor and the external device. The communication interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a data processing method based on a relational database.
In an exemplary embodiment, a computer device, which may be a terminal, is provided, and an internal structure diagram thereof may be as shown in fig. 6. The computer device includes a processor, a memory, an input/output interface, a communication interface, a display unit, and an input means. The processor, the memory and the input/output interface are connected through a system bus, and the communication interface, the display unit and the input device are connected to the system bus through the input/output interface. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The input/output interface of the computer device is used to exchange information between the processor and the external device. The communication interface of the computer device is used for carrying out wired or wireless communication with an external terminal, and the wireless mode can be realized through WIFI, a mobile cellular network, NFC (near field communication) or other technologies. The computer program is executed by a processor to implement a data processing method based on a relational database. The display unit of the computer device is used for forming a visual picture, and can be a display screen, a projection device or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, can also be a key, a track ball or a touch pad arranged on the shell of the computer equipment, and can also be an external keyboard, a touch pad or a mouse and the like.
It will be appreciated by those skilled in the art that the structure shown in FIG. 6 is merely a block diagram of some of the structures associated with the present inventive arrangements and is not limiting of the computer device to which the present inventive arrangements may be applied, and that a particular computer device may include more or fewer components than shown, or may combine some of the components, or have a different arrangement of components.
In one exemplary embodiment, a computer device is provided, including a memory and a processor, where the memory stores a computer program, and the processor implements the steps of acquiring data to be processed and start instruction information, and starting a target processing task according to the start instruction information, where the start instruction information is generated based on start condition trigger information of the target processing task and end instruction information of a previous cycle, acquiring dependency information between the target processing task and the target associated task, executing the target processing task according to the data to be processed, generating end instruction information of a current cycle, and generating start condition trigger information of the target associated task according to the dependency information, so as to trigger the start of the target associated task and the target processing task of a next cycle.
In one embodiment, the processor further performs the steps of acquiring data to be processed, generating start instruction information according to start condition triggering information of a target processing task and end instruction information of a previous period when the data to be processed is data which is necessary and the data acquisition is complete, starting the target processing task according to the start instruction information, acquiring a start configuration table when the data to be processed is data which is not necessary, and generating start instruction information according to the start condition in the start configuration table, the start condition triggering information of the target processing task and the end instruction information of the previous period and starting the target processing task according to the start instruction information when the data to be processed is data which is not necessary.
In one embodiment, the processor further performs the steps of determining the starting time of the target processing task according to the starting configuration table, and generating starting instruction information according to the starting condition trigger information of the target processing task and the ending instruction information of the previous period when the starting time arrives.
In one embodiment, the processor further performs the steps of determining a start time and a preset waiting time according to the start configuration table when the data is not necessary to be delay start data, generating start instruction information according to start condition trigger information of the target processing task and end instruction information of a previous period when the start time arrives and delay start data acquisition is complete, starting to count the waiting time when the start time arrives and delay start data acquisition is incomplete, and generating start instruction information according to start condition trigger information of the target processing task and end instruction information of the previous period when the waiting time is equal to the preset waiting time or delay start data acquisition is complete.
In one embodiment, the processor when executing the computer program further performs the step of obtaining the data to be processed and the start instruction information in response to the total start instruction for the current workspace.
In one embodiment, the processor further realizes the following steps of executing the target processing task according to the data to be processed, generating ending instruction information of the period, responding to a total starting instruction of a current working area of the next period to trigger starting the target processing task of the next period, generating starting condition triggering information of the target associated task according to the dependency relationship information, and responding to the total starting instruction of the working area to which the target associated task belongs to trigger starting the target associated task.
In one embodiment, a computer readable storage medium is provided, on which a computer program is stored, which when executed by a processor, implements the steps of obtaining data to be processed and start instruction information, and starting a target processing task according to the start instruction information, wherein the start instruction information is generated based on start condition trigger information of the target processing task and end instruction information of a previous cycle, obtaining dependency information between the target processing task and the target associated task, executing the target processing task according to the data to be processed, generating end instruction information of a current cycle, and generating start condition trigger information of the target associated task according to the dependency information, so as to trigger the start of the target associated task and the target processing task of a next cycle.
In one embodiment, the computer program when executed by the processor further comprises the steps of obtaining data to be processed, generating start instruction information according to start condition triggering information of a target processing task and end instruction information of a previous period when the data to be processed is data which is necessary and the data is necessary to be obtained completely, starting the target processing task according to the start instruction information, obtaining a start configuration table when the data to be processed is data which is not necessary, and generating start instruction information according to start condition triggering information of the target processing task and end instruction information of the previous period and starting the target processing task according to the start instruction information.
In one embodiment, the computer program when executed by the processor further implements the steps of determining a start time of the target processing task according to the start configuration table, and generating start instruction information according to start condition trigger information of the target processing task and end instruction information of a previous cycle when the start time arrives.
In one embodiment, the computer program when executed by the processor further comprises the steps of determining a start time and a preset waiting time of the target processing task according to the start configuration table when the data is not necessary to be the delay start data, generating start instruction information according to start condition triggering information of the target processing task and end instruction information of the previous period when the start time arrives and delay start data acquisition is complete, starting to count the waiting time when the start time arrives and delay start data acquisition is incomplete, and generating start instruction information according to start condition triggering information of the target processing task and end instruction information of the previous period when the waiting time is equal to the preset waiting time or delay start data acquisition is complete.
In one embodiment, the computer program when executed by the processor further performs the step of obtaining the data to be processed and the start instruction information in response to the total start instruction for the current workspace.
In one embodiment, the computer program when executed by the processor further comprises the steps of executing the target processing task according to the data to be processed, generating ending instruction information of the period, responding to a total starting instruction of a current working area of the next period to trigger starting the target processing task of the next period, generating starting condition triggering information of the target associated task according to the dependency relationship information, and responding to the total starting instruction of the working area to which the target associated task belongs to trigger starting the target associated task.
In one embodiment, a computer program product is provided, which comprises a computer program, wherein the computer program is executed by a processor and realizes the following steps of acquiring data to be processed and starting instruction information, and starting a target processing task according to the starting instruction information, wherein the starting instruction information is generated based on starting condition trigger information of the target processing task and ending instruction information of a previous period, acquiring dependency information between the target processing task and a target associated task, executing the target processing task according to the data to be processed, generating ending instruction information of a current period, and generating starting condition trigger information of the target associated task according to the dependency information so as to trigger the starting of the target associated task and the target processing task of a next period.
In one embodiment, the computer program when executed by the processor further comprises the steps of obtaining data to be processed, generating start instruction information according to start condition triggering information of a target processing task and end instruction information of a previous period when the data to be processed is data which is necessary and the data is necessary to be obtained completely, starting the target processing task according to the start instruction information, obtaining a start configuration table when the data to be processed is data which is not necessary, and generating start instruction information according to start condition triggering information of the target processing task and end instruction information of the previous period and starting the target processing task according to the start instruction information.
In one embodiment, the computer program when executed by the processor further implements the steps of determining a start time of the target processing task according to the start configuration table, and generating start instruction information according to start condition trigger information of the target processing task and end instruction information of a previous cycle when the start time arrives.
In one embodiment, the computer program when executed by the processor further comprises the steps of determining a start time and a preset waiting time of the target processing task according to the start configuration table when the data is not necessary to be the delay start data, generating start instruction information according to start condition triggering information of the target processing task and end instruction information of the previous period when the start time arrives and delay start data acquisition is complete, starting to count the waiting time when the start time arrives and delay start data acquisition is incomplete, and generating start instruction information according to start condition triggering information of the target processing task and end instruction information of the previous period when the waiting time is equal to the preset waiting time or delay start data acquisition is complete.
In one embodiment, the computer program when executed by the processor further performs the step of obtaining the data to be processed and the start instruction information in response to the total start instruction for the current workspace.
In one embodiment, the computer program when executed by the processor further comprises the steps of executing the target processing task according to the data to be processed, generating ending instruction information of the period, responding to a total starting instruction of a current working area of the next period to trigger starting the target processing task of the next period, generating starting condition triggering information of the target associated task according to the dependency relationship information, and responding to the total starting instruction of the working area to which the target associated task belongs to trigger starting the target associated task.
It should be noted that, the user information (including but not limited to user equipment information, user personal information, etc.) and the data (including but not limited to data for analysis, stored data, presented data, etc.) related to the present application are both information and data authorized by the user or sufficiently authorized by each party, and the collection, use and processing of the related data are required to meet the related regulations.
Those skilled in the art will appreciate that implementing all or part of the above described methods may be accomplished by way of a computer program stored on a non-transitory computer readable storage medium, which when executed, may comprise the steps of the embodiments of the methods described above. Any reference to memory, database, or other medium used in embodiments provided herein may include at least one of non-volatile and volatile memory. The nonvolatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical Memory, high density embedded nonvolatile Memory, resistive random access Memory (ReRAM), magneto-resistive random access Memory (Magnetoresistive Random Access Memory, MRAM), ferroelectric Memory (Ferroelectric Random Access Memory, FRAM), phase change Memory (PHASE CHANGE Memory, PCM), graphene Memory, and the like. Volatile memory can include random access memory (Random Access Memory, RAM) or external cache memory, and the like. By way of illustration, and not limitation, RAM can be in various forms such as static random access memory (Static Random Access Memory, SRAM) or dynamic random access memory (Dynamic Random Access Memory, DRAM), etc. The databases referred to in the embodiments provided herein may include at least one of a relational database and a non-relational database. The non-relational database may include, but is not limited to, a blockchain-based distributed database, and the like. The processor referred to in the embodiments provided in the present application may be a general-purpose processor, a central processing unit, a graphics processor, a digital instruction processor, a programmable logic unit, a data processing logic unit based on quantum computing, or the like, but is not limited thereto.
The technical features of the above embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.
The foregoing examples illustrate only a few embodiments of the application and are described in detail herein without thereby limiting the scope of the application. It should be noted that it will be apparent to those skilled in the art that several variations and modifications can be made without departing from the spirit of the application, which are all within the scope of the application. Accordingly, the scope of the application should be assessed as that of the appended claims.