Detailed Description
Exemplary embodiments of the present invention will now be described with reference to the accompanying drawings, in which various details of the embodiments of the present invention are included to facilitate understanding, and are to be considered merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
Fig. 1 is a schematic diagram of main steps of a data processing method according to an embodiment of the present invention.
As shown in fig. 1, the data processing method of the embodiment mainly includes the following steps S101 to S103.
Step S101: and receiving the input business requirement information.
The business requirement information includes business logic descriptions such as: and acquiring the freight list number of the checked freight, and updating the freight list number and the checking time into a database if the freight list number is not undefined. A user (e.g., a developer of data processing, etc.) may enter business requirement information via a visual requirement input interface, which may also include business requirement descriptions such as: the goods arrive at the station, the station length checks the goods, and the time of checking is accessed.
Step S102: and carrying out logic analysis on the input business requirement information by utilizing pre-stored business description information so as to determine a data source corresponding to the business requirement information.
The pre-stored service description information is pre-stored in each existing data source, and each data source is a database table, which may also be called a data source table, such as a goods checking table, a goods receiving table, and the like.
Step S102 may specifically include:
the method comprises the steps of segmenting business requirement information to obtain each segmented word of business requirements;
Calculating the word frequency weight total value of each word in each data source of the service requirement by utilizing the service description information pre-stored in each data source;
And determining a data source corresponding to the service demand information according to the calculated word frequency weight total value.
Each word of the business requirement is stored in a requirement characteristic table. After the business demand information is segmented, the step of manually checking the segmented word and then calculating the total value of word frequency weight can be performed, and the manual checking process specifically comprises the following steps: setting the words which are successfully segmented to yellow (font display color can be controlled through css (cascading style sheet)), performing secondary browsing scanning by a developer, marking off the words which are missing supplementary notes or do not contain context by automatic scanning, clicking for storage after checking, and analyzing the characteristics after recording the marked-off words and the supplementary notes so as to expand a database by the next segmentation.
The word frequency weight total value of each word of the service requirement in the data source can be calculated by using the service description information pre-stored in the data source in the following way:
according to the occurrence frequency of each word in the word segmentation set of the data source, the word frequency of each word in the data source is obtained, wherein the word segmentation set of the data source is obtained by word segmentation of the service description information pre-stored in the data source;
according to the word frequency of each word in the data source of the service requirement and the total word segmentation amount of the word segmentation set of the data source, respectively calculating the weight value of each word in the data source of the service requirement, wherein the weight value of a certain word in the data source is equal to the ratio of the word frequency of the word in the data source to the total word segmentation amount of the word segmentation set of the data source;
According to the weight value of each word in the data source of the service requirement, the word frequency weight total value of each word in the data source of the service requirement is obtained, and specifically, the calculation method of the word frequency weight total value of each word in the data source of the service requirement is as follows: and de-weighting each word segment of the service requirement, and adding the weight value of each de-weighted word segment in the data source to obtain the word frequency weight total value of each word segment of the service requirement in the data source, namely adding the weight values of the same word segment only once without repeated addition when adding the weight values to obtain the word frequency weight total value.
The step of determining the data source corresponding to the service requirement information according to the word frequency weight total value specifically may include:
Determining that word frequency weight total values larger than a preset threshold exist among word frequency weight total values of all the data sources of each word of the service requirement;
and determining a data source corresponding to the maximum word frequency weight total value from word frequency weight total values larger than a preset threshold as the data source corresponding to the service demand information.
The preset threshold value can be defined by user, because the total word frequency weight value is a numerical value greater than or equal to 0 and less than or equal to 1, a numerical value greater than or equal to zero and less than 1 can be defined by user as the preset threshold value according to the requirement, for example, the preset threshold value is defined as 0, when the preset threshold value is 0, each word of the service requirement is among the total word frequency weight values of all the data sources, and the data source corresponding to the maximum total word frequency weight value is determined as the data source corresponding to the service requirement information.
If the pre-stored service description information is utilized to carry out logic analysis on the input service requirement information, the data source corresponding to the service requirement information cannot be determined, in other words, if each word of the service requirement is among the word frequency weight total values of all the data sources, and the word frequency weight total value larger than a preset threshold value does not exist, the data source corresponding to the service requirement information is determined according to a preset requirement circulation rule.
The requirement circulation rule may be preset according to the service requirement, for example, the requirement circulation rule may include rules such as forwarding, topping, comment, scoring, upgrading, responsibility fixing, and the like.
And forwarding, wherein the developer can forward the service requirement to related personnel such as a product manager or a project manager, and the related personnel assist in determining a data source corresponding to the service requirement information.
And (3) topping, namely under the condition that a developer, a product manager, a project manager and the like cannot decide a data source corresponding to the service requirement information, the developer can topping the service requirement to an unresolved data source requirement list, wherein the unresolved data source requirement list is a service requirement list interface for displaying all unresolved data sources so as to enable all developers, product managers, project managers and data producers participating in data processing to read and comment on each link.
And commentary, namely, after the business requirement is set up to an unresolved data source requirement list, all people can participate in the business requirement commentary, and all commentary is fed back to developers, product managers and the like of the business requirement.
Scoring, namely, a developer browses feedback information of related business requirement comments, and scoring is carried out on the feedback person once the correct feedback data source comments are found.
Upgrading, i.e. if no data source has been queried for the business requirement within a limited time, the business requirement is automatically upgraded to the department manager for the department manager to coordinate resource resolution.
Responsibility-determining, i.e., if the data source has not been queried for the business requirement within a limited time (typically longer than the time-limited for the upgrade), is performed by the department manager to the person to determine the data source by the person to whom responsibility is determined.
The requirement circulation rule can also comprise a multi-disc, namely after a certain service requirement is inquired about a data source through links such as forwarding, commenting, upgrading and the like, the relation between service requirement characteristics and the data source is automatically analyzed, the reasons of the logic analysis of the service requirement information are recorded, the reasons of the disfavored service requirement information are filled in a requirement characteristic table and a data source table, a disfavored service analysis processing mechanism is perfected, whether the service requirement information accords with a preset specification can be judged through multi-disc analysis, and after the service requirement information is confirmed to accord with the preset specification, each word of the service requirement is saved in the data source corresponding to the confirmed service requirement information, so that the database of the data source is expanded, and the next word can be directly used. If the business requirement information does not meet the preset specification, a prompt message can be output to the developer so that the developer can correct the input business requirement information.
Step S103: and executing executable codes corresponding to the business logic description by utilizing the data in the data source corresponding to the business requirement information so as to obtain a data processing result.
In one embodiment, before step S103, executable code corresponding to the service logic description may be generated according to the service logic description and according to a message processing template matched with a data source corresponding to the service requirement information.
Specifically, extracting Chinese keywords from service logic description, and extracting the segmentation words belonging to the service logic description from the segmentation words of service requirements; and generating the executable code by using the code keywords corresponding to the extracted Chinese keywords and the fields corresponding to the segmentation words belonging to the service logic description in the data source corresponding to the service requirement information.
It will be understood by those skilled in the art that this embodiment is a preferred embodiment of generating executable codes for the embodiment of the present invention, and in other embodiments, for example, the executable codes corresponding to the service logic description in the step S103 are generated by manual writing, and in combination with the step S101 and the step S102, the technical effects of automatically matching the data sources according to the service requirement information and having high working quantification can be achieved by the embodiment of the present invention.
Before step S103, the service logic in the executable code may be confirmed to conform to the service logic description in the service requirement information by using the data in the data source corresponding to the service requirement information.
For example, in the above-mentioned embodiment, after the executable code corresponding to the service logic description is generated according to the message processing template matched with the data source corresponding to the service requirement information according to the service logic description, the data in the data source corresponding to the service requirement information may be automatically utilized to test whether the service logic in the executable code conforms to the service logic description in the service requirement information, and step S103 is performed after it is determined that the service logic in the executable code conforms to the service logic description in the service requirement information.
The invention also provides an agile data processing platform (data processing platform for short), and the data processing platform executes the data processing method of the embodiment of the invention to process data after being started. The data processing platform of the embodiment of the invention can be developed by an independent module/unit, specifically, a visual demand input interface (in the form of a Web interface) is used as an operation unit for agile data processing, and the development stage of data processing is divided into three functional modules: the data input module, the logic analysis system and the code generator take the three built-in functional modules as basic units, and realize the realization of data processing by the actual business drive, thereby realizing the visual development.
The agile data processing platform of the embodiment of the invention is described below by taking data processing in the e-commerce field as an example. The embodiment of the invention is not only limited to the data processing in the e-commerce field, but also can be used in the scenes that the data source is required to be positioned, the data processing code is required to be written and the data processing code is executed to process the data in various fields.
In an e-commerce system, typically, the data processing may involve a third party service, for example, a transportation service, in a data processing scenario involving the third party service, service requirement information is input by a developer of the data processing, and pre-stored service description information is input by a third party service producer, so in the agile data processing platform of the present embodiment, data input for two different roles may be supported: demand entry and third party business information data entry.
The method comprises the steps of inputting requirements, serving common data processing developers, inputting service requirement information in a channel by the developers, wherein the service requirement information comprises service requirement description and service logic description, and after the data processing platform performs preliminary verification on the input service requirement information, transmitting the information to a logic analysis system to complete acquisition of the requirement information.
The third party service information data entry is used for a producer of data on a third party service line, the producer enters respective service description information, including service description, service field description of a producer database and the like, for screening, comparing and filtering by a logic analysis system, and the two data entries are applied to different roles and cooperate together to complete the identification of service requirements.
In the data processing flow, the two types of data input are not necessarily performed simultaneously (usually not performed simultaneously), and the third party service information data can be input and stored in advance and read at any time when in use.
In addition to the two data entry functions, the data entry module has a data circulation function for maintaining the identification of the service requirement, for example, when the service requirement information is entered, the logic analysis system analyzes and compares the entered service requirement information, and once the service feature of the service requirement cannot be found in the built-in database corresponding to the data processing platform, the requirement circulation function is started, which specifically includes functions of forwarding, topping, commenting, scoring, upgrading, responsibility fixing, disc multiplexing and the like, and these functions are described in detail above and are not repeated here. The embodiment of the invention enables base oneself on relations between the business and the data source to form a document for each relevant person to review.
In order to more clearly understand the working process of the data entry module in the embodiment of the present invention, development steps of the data entry module in the agile data processing platform need to be introduced. Firstly, defining a data input template, and abstracting a set of common attributes for requirement input and third-party business information data input, wherein the common attributes comprise: a requirement identifier (an identifier of a service requirement), an input content (including a service requirement description, a service logic description and the like), an input time, an input person and the like, wherein the common attribute table has only an insertion function and no updating function, and the requirement identifier is used for judging whether a plurality of services are the same service requirement (the updating function is removed to keep a history record); the third party business information data entry also requires a private attribute list for describing the producer database fields and their meaning descriptions, the private attributes including: business description of the table (i.e. what business the table stores is associated with the need identification in the common attribute table), field name, field description whether the data is field-produced (data field production refers to that the data is generated by a first line personnel operation, for example, the data generated by a first line delivery end is the data belonging to field production), etc., and the private attributes are stored in the word segmentation table after being entered, so as to provide text similarity comparison for the logic analysis system. A schematic diagram of the composition of the common attribute and the private attribute is shown in fig. 2. Then develop demand flow buttons such as: the specific functions of the buttons such as forwarding, topping, commenting, scoring, upgrading, responsibility fixing, disc multiplexing and the like.
It should be noted that, the data processing platform of the embodiment of the present invention is not limited to the data processing scenario involving the third party service, but is also applicable to the data processing scenario not involving the third party service, in which the service requirement information and the pre-stored service description information may be input in a unified manner by the developer of the data processing, where the pre-stored service description information is correspondingly self-service information data, but not third party service information data.
The logic analysis system performs demand collection on the service demand information input by the data input module, performs logic analysis on the input service demand information by utilizing pre-stored service description information so as to determine a data source corresponding to the service demand information, and specifically, the data source corresponding to the service demand information can be accurately positioned only through the following stages.
The first stage is to word the requirement, which refers to segmenting a series of Chinese character sequences into individual lexical units, the embodiment can use various word segmentation algorithms to complete word segmentation of the service requirement information, and the specific steps of word segmentation of the service requirement information are introduced by taking word segmentation (a distributed Chinese word segmentation component realized by Java) as an example:
Introducing a maven dependent package:
word segmentation is carried out on the text:
List < Word > words = wordssegmenter. Seg ("demand entry text");
words displays segmented content, for example, if the demand entry text (e.g., business demand description) is: "goods arrive at the station, the station length checks the goods, the time of access check", the words is displayed as follows: [ goods, arrival, station length, acceptance, goods, access, acceptance ].
Carrying out manual secondary verification on the demand:
After word segmentation, the words which are successfully segmented are placed in yellow (font display color can be controlled through css (cascading style sheets)), a developer performs secondary browsing scanning, the words which are missing supplementary notes or do not contain context are segmented through automatic scanning, after verification is correct, clicking is performed for storage, a logic analysis system automatically records the segmented words and supplementary notes, and the characteristics of the segmented words and the supplementary notes are analyzed, so that a database is expanded through next word segmentation.
And in the second stage, keyword word frequency weight analysis is carried out on each word of the business requirement and the word of the word segmentation list. The word segmentation list is a data source (or called a data source list), wherein the stored content comprises service description information input by a third party service producer, service field description (such as field name, field description and the like) of a producer database and a word segmentation set obtained after the service description information is segmented.
The specific process of keyword word frequency weight analysis is described below by taking two word segmentation tables, namely a goods checking table and a goods receiving table, as examples. Wherein, the goods checking list (private attribute structure of the third party business information site goods checking list) is shown in table 1. The receipt form (third party business information site receipt form private attribute structure) is as in table 2.
TABLE 1
TABLE 2
| Field name | Field description | Business description of a Table | Word segmentation set |
| receive_id | Main key | Main key ID of site receipt list | [ Site, receipt, form, primary key, id ] |
| waybill_code | Number of bill of fortune | The bill number, the site receives the bill as dimension | [ Site, receipt, order, dimension ] |
| create_site_id | Creation site | Is received by which site | [ Site, receiving ] |
| create_time | Creation time | Time of receipt | [ Time for receiving goods ] |
| create_user_id | Operator ID | ID records erp information | [ Id, record, erp, info ] |
| create_user | Operator name | The name is the name of erp | [ Erp, name ] |
Assuming that the recorded business demand information is 'goods arrive at a station, checking goods by a station length, and accessing to check goods time', obtaining each word of the business demand through word segmentation is as follows: [ goods, arrival, station length, check goods, access, check goods, time ]. In the word segmentation set of the goods inspection table in table 1, the "site" appears 3 times, the "goods inspection" appears 4 times, the "time" appears 1 time, and the other words appear 0 times. Namely, the word frequency of the station, the goods inspection and the time in the goods inspection list is 3, 4 and 1 respectively, and the word frequency of other word segmentation in the goods inspection list is 0.
The total word segmentation amount in the word segmentation set of the goods checking list is 19, and the weight value of the station in the goods checking list is as follows: the ratio of the word frequency of the station in the inspection table to the total word segmentation amount in the word segmentation set of the inspection table is 3/19. Similarly, the weight value of other words in the business requirement in the goods checking list is calculated, the weight value of 'goods checking' in the goods checking list is 4/19, the weight value of 'time' in the goods checking list is 1/19, and the weight value of other words in the goods checking list is 0.
Because two 'goods checking' exist in each word of the business requirement, the 'goods checking' is de-duplicated, namely, when the word frequency weight total value of each word of the business requirement in the goods checking table is calculated, only one weight value of the two 'goods checking' is taken, so that the word frequency weight total value of each word of the business requirement in the goods checking table is equal to: the sum of the weight values of the de-duplicated segmented words of the business requirement in the goods checking list,
For this example, it is: 3/19+4/19+1/19=8/19.
According to the same method, calculating the word frequency weight total value of each word in the receiving list, which can obtain the service requirement, as follows: 3/19 ("weight of station" in the receipt table) +1/19 ("weight of time" in the receipt table) =4/19.
For convenience of description, this example only includes two word segmentation tables, namely, a goods inspection table and a goods receiving table, and when determining a data source, this example defines a preset threshold value as 0, that is, if each word segment of the service requirement is in the word frequency weight total value of each data source (namely, the goods inspection table and the goods receiving table in this example), the word frequency weight total value greater than 0 exists, and then the goods inspection table corresponding to the maximum word frequency weight total value (8/19) is determined as the data source corresponding to the service requirement information.
In this example, the logic analysis system performs logic analysis on the input service requirement information, so that it can determine that the data source corresponding to the service requirement information is the inspection table, and therefore, it is not necessary to determine the data source through the requirement circulation.
In other embodiments, if the data source corresponding to the service requirement information is not queried (or determined) by the logic analysis method, a third stage is required to be performed, and the data source is determined by manual intervention according to a preset requirement circulation rule. When a data source is queried through the manual demand circulation function, a demand multi-disc analysis function is started to carry out multi-disc data association and supplementary recording, whether the demand meets the specification is firstly judged, then a result after the business demand word segmentation is stored in a word segmentation table, and a word segmentation table database is expanded to enable the next word segmentation to be directly used.
After determining the data source, entering a code writing stage, the embodiment of the invention does not need to write English codes, only needs to describe Chinese, and the code generator can automatically complete the conversion of the English codes.
First, it is necessary to embed Chinese keywords and the generation formula in the data processing platform, as shown in Table 3. The production formula reflects the correspondence between the chinese key and the code key, for example, the chinese key "if" corresponds to the code key "if".
TABLE 3 Table 3
For example, business logic is described as "get manifest number for check, if the manifest number is not undefined, then the manifest number, the check time is updated to the database. The code generator may first perform a need check.
Specifically, the word of the service logic description is compared with the built-in Chinese keyword and the pre-stored service description information in the word list, and the word which can be identified in the word of the service logic description is marked, for example, the word which is not marked as "correspondingto-! = ", undefined" is marked as "null", and "time of check" is marked as "data source table field", and so on. Extracting the unrecognizable words individually, putting the unrecognizable words into a temporary word segmentation list, and simultaneously manually associating the unrecognizable words with the Chinese keywords and the service description information in the word segmentation list, for example, judging "then" as "just", and establishing association. If no related item is queried, starting workflow approval, applying unidentifiable words and descriptions thereof to an upper level, creating new Chinese keywords or similar texts of the word segmentation list after approval, thereby completing requirement verification, and if the words of the temporary word segmentation list are matched with the word segmentation described by the business logic for a plurality of times, putting the words in the temporary word segmentation list into a formal word segmentation list. An exemplary flow of the demand check is shown in fig. 3 (step S301 to step S303).
After the need check is completed, a generation stage of executable code is entered. Since it has been determined that the data source (data source table) is the inspection table, executable code corresponding to the business logic description may be generated according to the business logic description and the message processing template matched with the inspection table. Specifically, firstly, whether the check list is a kafka (a high-throughput distributed publish-subscribe message system) message or other message middleware system message is judged, and different message processing templates are generated according to different message sources, wherein the message middleware system message templates are shown in fig. 4. Starting mathematical model abstraction, replacing the word segmentation belonging to service logic description by the corresponding field in the word segmentation list, replacing the Chinese keyword by a java character sequence, replacing the generating formula by a character sequence conforming to java judgment, filling auxiliary logic such as void judgment, abnormality and the like, generating a java file at the same time, and compiling to generate a class file.
After the code generator generates the code, the data in the goods inspection table can be used for carrying out unit test, namely whether the business logic in the generated code accords with the business logic description in the business requirement information or not is tested, and after the test is passed, the generated code is operated to carry out data processing.
The data processing platform may also include a monitoring module for printing (outputting) a system log of the data processing platform.
Based on the above description of the data processing platform according to the embodiment of the present invention, a schematic diagram of the data processing platform according to the embodiment of the present invention may be referred to fig. 5.
After each module is replaced by a platform, the management standard of the unified data processing flow is facilitated, and the agile data processing platform of the embodiment automates the functions of two key links (determining a data source and generating codes) of data processing, so that a developer does not need to write a line of codes, only needs to describe service logic in Chinese on a visual interface, the agile data processing platform can automatically complete acquisition of the data source and writing of a processing program, and in addition, a visual test module is provided to automatically test the codes generated by a code generator, thereby completing the data processing flow rapidly, saving time cost, and facilitating unification and standardization of data processing.
Fig. 6 is a schematic diagram of main modules of a data processing apparatus according to an embodiment of the present invention.
As shown in fig. 6, the data processing apparatus 600 according to the embodiment of the present invention mainly includes: a demand receiving module 601, a first data source determining module 602, and a data processing module 603.
The requirement receiving module 601 is configured to receive input service requirement information, where the service requirement information includes a service logic description.
The first data source determining module 602 is configured to logically analyze the service requirement information by using pre-stored service description information, so as to determine a data source corresponding to the service requirement information.
The first data source determination module 602 is specifically operable to:
the method comprises the steps of segmenting business requirement information to obtain each segmented word of business requirements;
Calculating the word frequency weight total value of each word in each data source of the service requirement by utilizing the service description information pre-stored in each data source;
And determining a data source corresponding to the service demand information according to the calculated word frequency weight total value.
The first data source determination module 602 may include a word frequency weight total value determination sub-module for:
According to the occurrence frequency of each word in the word segmentation set of the data source, the word frequency of each word in the data source is obtained, wherein the word segmentation set of the data source is obtained by word segmentation of the service description information pre-stored in the data source;
according to the word frequency of each word of the service requirement in the data source and the total word segmentation quantity of the word segmentation set of the data source, respectively calculating the weight value of each word of the service requirement in the data source;
and obtaining the word frequency weight total value of each word of the service requirement in the data source according to the weight value of each word of the service requirement in the data source.
The first data source determination module 602 may further include a data source determination submodule for:
Determining that word frequency weight total values larger than a preset threshold exist among word frequency weight total values of all the data sources of each word of the service requirement;
And determining a data source corresponding to the maximum word frequency weight total value as a data source corresponding to the service demand information from among word frequency weight total values larger than a preset threshold.
The data processing apparatus 600 may further comprise a second data source determination module for: if the word frequency weight total value of each word of the service requirement is not greater than the preset threshold value in the word frequency weight total values of each data source, determining the data source corresponding to the service requirement information according to the preset requirement circulation rule.
The second data source determination module may include a multiple disk analysis sub-module for: and determining that the service demand information accords with a preset specification through multi-disc analysis, and then storing each word of the service demand into a data source corresponding to the determined service demand information.
The data processing module 603 is configured to execute executable code corresponding to the service logic description by using data in a data source corresponding to the service requirement information, so as to obtain a data processing result.
The data processing apparatus 600 may further comprise a code generation module for: and generating executable codes corresponding to the business logic description according to the message processing template matched with the data source corresponding to the business requirement information according to the business logic description.
The code generation module is specifically used for: extracting Chinese keywords from the business logic description and extracting the word fragments belonging to the business logic description from the word fragments of the business requirements; and generating executable codes by using the code keywords corresponding to the Chinese keywords and the fields corresponding to the segmentation belonging to the service logic description in the determined data source.
The data processing apparatus 600 may further comprise a test module for: judging whether the business logic in the executable code accords with the business logic description by utilizing the data in the data source corresponding to the business requirement information, if so, executing the executable code corresponding to the business logic description by the data processing module 603 by utilizing the data in the data source corresponding to the business requirement information to obtain a data processing result, otherwise, correcting the executable code to ensure that the business logic accords with the business logic description, and then executing the data processing.
The data processing apparatus 600 of the embodiment of the present invention may be implemented in an agile data processing platform, where the modules with the same functions as those in the data processing apparatus 600 in the agile data processing platform may be used as corresponding modules in the data processing apparatus 600, for example, a visual requirement input interface may be combined with a data entry module to implement corresponding functions as a requirement receiving module 601, a logic analysis system may implement functions of a first data source determining module 602 and a second data source determining module, a code generator may implement functions of a code generating module and a testing module, and the data processing module 603 is not shown in the agile data processing platform of fig. 5, but by the description of the agile data processing platform, after a code generated by the code generator passes a test, a data processing may be performed by running the generated code, so that a person skilled in the art may understand that executing the code generated by the agile data processing platform easily implements the functions of the data processing module 603.
In addition, the specific implementation of the data processing apparatus in the embodiments of the present invention has been described in detail in the above-described data processing method, and thus the description thereof will not be repeated here.
Fig. 7 illustrates an exemplary system architecture 700 to which a data processing method or data processing apparatus of an embodiment of the present invention may be applied.
As shown in fig. 7, a system architecture 700 may include terminal devices 701, 702, 703, a network 704, and a server 705. The network 704 is the medium used to provide communication links between the terminal devices 701, 702, 703 and the server 705. The network 704 may include various connection types, such as wired, wireless communication links, or fiber optic cables, among others.
A user may interact with the server 705 via the network 704 using the terminal devices 701, 702, 703 to receive or send messages or the like. Various communication client applications such as shopping class applications, web browser applications, search class applications, instant messaging tools, mailbox clients, social platform software, etc. (by way of example only) may be installed on the terminal devices 701, 702, 703.
The terminal devices 701, 702, 703 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smartphones, tablets, laptop and desktop computers, and the like.
The server 705 may be a server providing various services, such as a background management server (by way of example only) providing support for shopping-type websites browsed by users using the terminal devices 701, 702, 703. The background management server may analyze and process the received data such as the product information query request, and feedback the processing result (e.g., the target push information, the product information—only an example) to the terminal device.
It should be noted that, the data processing method provided in the embodiment of the present invention is generally executed by the server 705, and accordingly, the data processing apparatus is generally disposed in the server 705.
It should be understood that the number of terminal devices, networks and servers in fig. 7 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation.
Referring now to FIG. 8, there is illustrated a schematic diagram of a computer system 800 suitable for use in implementing a server of an embodiment of the present application. The server illustrated in fig. 8 is merely an example, and should not be construed as limiting the functionality and scope of use of embodiments of the present application.
As shown in fig. 8, the computer system 800 includes a Central Processing Unit (CPU) 801 that can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 802 or a program loaded from a storage section 808 into a Random Access Memory (RAM) 803. In the RAM 803, various programs and data required for the operation of the system 800 are also stored. The CPU 801, ROM 802, and RAM 803 are connected to each other by a bus 804. An input/output (I/O) interface 805 is also connected to the bus 804.
The following components are connected to the I/O interface 805: an input portion 806 including a keyboard, mouse, etc.; an output portion 807 including a display such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and a speaker; a storage section 808 including a hard disk or the like; and a communication section 809 including a network interface card such as a LAN card, a modem, or the like. The communication section 809 performs communication processing via a network such as the internet. The drive 810 is also connected to the I/O interface 805 as needed. A removable medium 811 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 810 as needed so that a computer program read out therefrom is mounted into the storage section 808 as needed.
In particular, according to the disclosed embodiments of the application, the processes described above with reference to the main step schematic diagrams may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method shown in the main step schematic. In such an embodiment, the computer program may be downloaded and installed from a network via the communication section 809, and/or installed from the removable media 811. The above-described functions defined in the system of the present application are performed when the computer program is executed by a Central Processing Unit (CPU) 801.
The computer readable medium shown in the present application may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present application, however, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
The primary step diagrams and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. In this regard, each block in the main step diagrams or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or main step diagrams, and combinations of blocks in the block diagrams or main step diagrams, can be implemented by special purpose hardware-based systems that perform the specified functions or operations, or combinations of special purpose hardware and computer instructions.
The modules involved in the embodiments of the present invention may be implemented in software or in hardware. The described modules may also be provided in a processor, for example, as: a processor comprises a demand receiving module 601, a first data source determining module 602, a data processing module 603. The names of these modules do not constitute a limitation on the module itself in some cases, and for example, the demand receiving module 601 may also be described as "a module for receiving input business demand information".
As another aspect, the present invention also provides a computer-readable medium that may be contained in the apparatus described in the above embodiments; or may be present alone without being fitted into the device. The computer readable medium carries one or more programs which, when executed by a device, cause the device to include: receiving input business requirement information, wherein the business requirement information comprises business logic description; carrying out logic analysis on the service demand information by utilizing pre-stored service description information so as to determine a data source corresponding to the service demand information; and executing executable codes corresponding to the business logic description by utilizing the data in the data source to obtain a data processing result.
According to the technical scheme of the embodiment of the invention, the pre-stored service description information is utilized to carry out logic analysis on the input service requirement information so as to determine the data source corresponding to the service requirement information, the data source can be automatically matched according to the service requirement information, the working quantification is high, the executable codes corresponding to the service logic description in the service requirement information are generated according to the message processing template matched with the data source corresponding to the service requirement, automatic code writing and debugging can be realized, non-programming personnel can develop the data processing codes, the code style is unified and easy to modify and maintain, the operation process of data processing is simplified and accelerated, the time cost is saved, the data processing efficiency is improved, and the unification and standardization of the data processing are facilitated.
The above embodiments do not limit the scope of the present invention. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives can occur depending upon design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the scope of the present invention.