CN110780970A - Data screening method, device, equipment and computer readable storage medium - Google Patents
Data screening method, device, equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN110780970A CN110780970A CN201911065021.0A CN201911065021A CN110780970A CN 110780970 A CN110780970 A CN 110780970A CN 201911065021 A CN201911065021 A CN 201911065021A CN 110780970 A CN110780970 A CN 110780970A
- Authority
- CN
- China
- Prior art keywords
- information
- data screening
- screening
- data
- configuration
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012216 screening Methods 0.000 title claims abstract description 323
- 238000000034 method Methods 0.000 title claims abstract description 61
- 230000001960 triggered effect Effects 0.000 claims abstract description 55
- 230000014509 gene expression Effects 0.000 claims description 82
- 238000001914 filtration Methods 0.000 claims description 58
- 238000012795 verification Methods 0.000 claims description 17
- 230000006870 function Effects 0.000 claims description 8
- 238000005516 engineering process Methods 0.000 abstract description 6
- 230000008569 process Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 7
- 238000004891 communication Methods 0.000 description 6
- 238000001514 detection method Methods 0.000 description 4
- 238000011161 development Methods 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000009795 derivation Methods 0.000 description 1
- 238000007667 floating Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/242—Query formulation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2457—Query processing with adaptation to user needs
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Mathematical Physics (AREA)
- Human Computer Interaction (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention relates to the technical field of financial science and technology, and discloses a data screening method, a data screening device, data screening equipment and a computer-readable storage medium. The data screening method is applied to a web page and comprises the following steps: when a data screening template configuration request triggered by a user is received, displaying a corresponding data screening template configuration interface; receiving a data screening template configuration instruction triggered by a user based on the data screening template configuration interface, and acquiring data screening configuration information carried in the data screening template configuration instruction; and generating a corresponding data screening template based on the data screening configuration information. The invention can solve the problems of complex operation and low screening efficiency of the existing data screening mode.
Description
Technical Field
The invention relates to the technical field of financial technology (Fintech), in particular to a data screening method, a device, equipment and a computer readable storage medium.
Background
With the development of computer technology, more and more technologies (big data, distributed, Blockchain, artificial intelligence, etc.) are applied to the financial field, and the traditional financial industry is gradually changing to financial technology (Fintech), but higher requirements are also put forward on the technologies due to the requirements of security and real-time performance of the financial industry.
In the big data era, every enterprise has huge business data, which contains huge value information, and how to screen the huge data volume to obtain the data set required by the user is very important. Currently, data screening usually refers to exporting data of a webpage into a local excel table, and then a user manually performs operations such as screening sorting and deleting on the data in the excel table according to the user's own needs, so as to obtain the required data through screening. The data are screened according to the existing mode, manual screening is performed after manual derivation is needed every time, the operation is complex, and the efficiency is low.
Disclosure of Invention
The invention mainly aims to provide a data screening method, a data screening device, data screening equipment and a computer readable storage medium, and aims to solve the problems of complex operation and low screening efficiency of the existing data screening mode.
In order to achieve the above object, the present invention provides a data screening method applied to a web page, the data screening method comprising:
when a data screening template configuration request triggered by a user is received, displaying a corresponding data screening template configuration interface;
receiving a data screening template configuration instruction triggered by a user based on the data screening template configuration interface, and acquiring data screening configuration information carried in the data screening template configuration instruction;
and generating a corresponding data screening template based on the data screening configuration information.
Optionally, the data screening template configuration interface includes a service information configuration interface, a field information configuration interface, and a screening information configuration interface, and the step of displaying the corresponding data screening template configuration interface when receiving a data screening template configuration request triggered by a user includes:
when a data screening template configuration request triggered by a user is received, displaying the service information configuration interface;
when a first interface switching instruction triggered by a user based on the service information configuration interface is received, displaying the field information configuration interface according to the first interface switching instruction;
and when a second interface switching instruction triggered by the user based on the field information configuration interface is received, determining a target switching interface according to the second configuration interface switching instruction, and displaying the screening information configuration interface or the service information configuration interface according to the target switching interface.
Optionally, if the target switching interface is a screening information configuration interface, before the step of displaying the screening information configuration interface according to the target switching interface, the method further includes:
detecting whether updating information of the field type in the field information configuration interface is received;
if so, acquiring updated field type configuration information, and updating an index field list and a dimension field list in the screening information configuration interface according to the updated field type configuration information;
the step of displaying the screening information configuration interface according to the target switching interface comprises the following steps:
and displaying the updated screening information configuration interface according to the target switching interface.
Optionally, the data screening configuration information includes screening index information, screening dimension information, and screening condition information, and the step of generating a corresponding data screening template based on the data screening configuration information includes:
generating a corresponding first expression according to a target index, an index field, an operation function and an operation symbol in the screening index information;
generating a corresponding second expression according to the target dimension and the dimension field in the screening dimension information,
generating a corresponding third expression according to the screening type and the screening information in the screening condition information;
and obtaining a corresponding data screening template based on the first expression, the second expression and the third expression.
Optionally, the data screening configuration information further includes data set configuration information, and before the step of obtaining the corresponding data screening template based on the first expression, the second expression, and the third expression, the method further includes:
determining the type of the selected data set according to the data set configuration information, and detecting whether the type of the selected data set is a preset type;
if the type is a preset type, acquiring input path information in the data set configuration information, and acquiring metadata path information based on the input path information and a preset character string;
if the metadata path information is not the preset type, determining that the preset path information is the metadata path information;
the step of obtaining the corresponding data screening template based on the first expression, the second expression and the third expression comprises:
and obtaining a corresponding data screening template based on the first expression, the second expression, the third expression and the metadata path information.
Optionally, before the step of receiving a data filtering template configuration instruction triggered by the user based on the data filtering template configuration interface, the data filtering method further includes:
when an input instruction triggered by a user based on the data screening template configuration interface is detected, acquiring input information and a target input object corresponding to the input instruction;
acquiring an input verification condition corresponding to the target input object, and detecting whether the input information meets the input verification condition;
and if the input verification condition is not met, generating corresponding prompt information to prompt the user to input errors.
Optionally, after the step of generating the corresponding data screening template based on the data screening configuration information, the data screening method further includes:
and when a data screening request triggered by a user is received, acquiring a target data screening template from the data screening template according to the data screening request, and screening data according to the target data screening template.
In addition, in order to achieve the above object, the present invention further provides a data filtering apparatus applied to a web page, the data filtering apparatus comprising:
the interface display module is used for displaying a corresponding data screening template configuration interface when receiving a data screening template configuration request triggered by a user;
the first acquisition module is used for receiving a data screening template configuration instruction triggered by a user based on the data screening template configuration interface and acquiring data screening configuration information carried in the data screening template configuration instruction;
and the template generating module is used for generating a corresponding data screening template based on the data screening configuration information.
In addition, to achieve the above object, the present invention also provides a data screening apparatus, including: a memory, a processor and a data filter stored on the memory and executable on the processor, the data filter when executed by the processor implementing the steps of the data filtering method as described above.
In addition, to achieve the above object, the present invention also provides a computer readable storage medium having stored thereon a data filtering program, which when executed by a processor, implements the steps of the data filtering method as described above.
The invention provides a data screening method, a data screening device, data screening equipment and a computer readable storage medium, wherein when a data screening template configuration request triggered by a user is received, a corresponding data screening template configuration interface is displayed; then, receiving a data screening template configuration instruction triggered by a user based on a data screening template configuration interface, and acquiring data screening configuration information carried in the data screening template configuration instruction; and generating a corresponding data screening template based on the data screening configuration information. Compared with the mode of exporting data through an excel table and then manually screening in the prior art, the method does not need manual exporting and screening for multiple times, so that the data screening operation process can be simplified, and the data screening efficiency is improved.
Drawings
FIG. 1 is a schematic diagram of an apparatus architecture of a hardware operating environment according to an embodiment of the present invention;
FIG. 2 is a schematic flow chart of a data screening method according to a first embodiment of the present invention;
FIG. 3 is a schematic diagram of a data filtering template configuration interface according to a first embodiment of the present invention;
fig. 4 is a schematic functional block diagram of a data screening apparatus according to a first embodiment of the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Referring to fig. 1, fig. 1 is a schematic device structure diagram of a hardware operating environment according to an embodiment of the present invention.
The data screening device in the embodiment of the invention can be a smart phone, and can also be a terminal device such as a Personal Computer (PC), a tablet Computer, a portable Computer and the like.
As shown in fig. 1, the data screening apparatus may include: a processor 1001, such as a CPU, a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., a Wi-Fi interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., a magnetic disk memory). The memory 1005 may alternatively be a storage device separate from the processor 1001.
Those skilled in the art will appreciate that the data screening apparatus configuration shown in fig. 1 does not constitute a limitation of the data screening apparatus and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
As shown in fig. 1, a memory 1005, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and a data filtering program.
In the terminal shown in fig. 1, the network interface 1004 is mainly used for connecting to a backend server and performing data communication with the backend server; the user interface 1003 is mainly used for connecting a client and performing data communication with the client; and the processor 1001 may be configured to invoke the data screening program stored in the memory 1005 and perform the various steps of the data screening method below.
Based on the hardware structure, the invention provides various embodiments of the data screening method.
The invention provides a data screening method.
Referring to fig. 2, fig. 2 is a schematic flow chart of a data screening method according to a first embodiment of the present invention.
In this embodiment, the data filtering method is applied to a web page, and the method includes:
step S10, when receiving a data screening template configuration request triggered by a user, displaying a corresponding data screening template configuration interface;
the data filtering method of this embodiment is implemented by a data filtering device, which takes a terminal (e.g., a PC, a smart phone) as an example for description. In this embodiment, when a user needs to perform data screening, a data screening template configuration request may be triggered through a web page of a terminal (e.g., a PC or a smart phone), and specifically, after a corresponding web page is opened and logged in, a data screening template creation option or icon may be clicked, that is, a data screening template configuration request may be triggered. At this time, when receiving a data filtering template configuration request triggered by a user, the terminal displays a corresponding data filtering template configuration interface.
The data filtering template configuration interface may include a service information configuration interface, a field information configuration interface, and a filtering information configuration interface, which are respectively shown in fig. 3(a), fig. 3(B), and fig. 3 (C).
Specifically, step 10 includes:
step a1, when receiving a data screening template configuration request triggered by a user, displaying the service information configuration interface;
a2, when a first interface switching instruction triggered by a user based on the service information configuration interface is received, displaying the field information configuration interface according to the first interface switching instruction;
step a3, when a second interface switching instruction triggered by the user based on the field information configuration interface is received, determining a target switching interface according to the second configuration interface switching instruction, and displaying the screening information configuration interface or the service information configuration interface according to the target switching interface.
In this embodiment, when a data filtering template configuration request triggered by a user is received, a service information configuration interface is displayed for the user to input or select some basic information, such as names, descriptions, icons, data set types, and the like of service types, as shown in fig. 3(a), it is understood that fig. 3(a) is only a schematic diagram, and does not represent that the basic information includes only information shown in the diagram, and a corresponding basic information input box or selection box may be set according to actual needs for the user to input or select. When a user clicks a 'next' button in the service information configuration interface, a first interface switching instruction can be triggered, and at the moment, when the terminal receives the first interface switching instruction triggered by the user based on the service information configuration interface, the field information configuration interface is displayed according to the first interface switching instruction. The field information configuration interface is used for a user to configure field information of the broad table, such as a field type, an extension type and the like, and besides the field type and the extension type, the field information configuration interface may further include a broad table field name and a chinese alias, as shown in fig. 3 (B). The Chinese alias is a Chinese expression corresponding to the wide-table field name, and the field of the table is generally a normalized English command and is difficult to understand sometimes, so that the table is prepared into a meaningful Chinese name, and the table is more convenient for a user to use. The field types may include decimals, strings, and dates, etc., and the extension types are typically some complementary configurations, e.g., decimals refers to the precision of a floating point number, "24, 2" refers to a 24-bit number, with 2 bits after the decimal point. When the user clicks the button of the previous step or the next step in the service information configuration interface, the second interface switching instruction can be triggered. At this time, when receiving a second interface switching instruction triggered by the user based on the field information configuration interface, the terminal determines a target switching interface according to the second configuration interface switching instruction, and then displays the screening information configuration interface or the service information configuration interface according to the target switching interface. For example, when "previous step" is clicked, the corresponding target switching interface is a service information configuration interface, and fig. 3(a) may be displayed; when "next" is clicked, the corresponding target switching interface is a screening information configuration interface, and fig. 3(C) may be displayed. As shown in fig. 3(C), the screening information configuration interface is used for the user to screen the indexes, dimensions, and screening conditions, and fig. 3(C) shows an extremely convenient interaction manner — dragging for the user to configure the indexes, dimensions, and screening conditions, specifically, the user can pop up and configure the corresponding configuration frame only by dragging the recommended dimension field and the recommended index field to the corresponding "dimension configuration" and "index configuration" areas (after configuration is performed, a new dimension or index is generated), in the "screening configuration", the system can automatically list a list of screening conditions for configuration, and the user can open the corresponding configuration frame by clicking to configure. In addition, the user may further set the selected index, dimension, and filtering condition to configure corresponding filtering index information, filtering dimension information, and filtering condition information, for example, if the index of loan interest rate is dragged into the index configuration, the user may click "loan interest rate" in the index configuration, and then set the filtering index information corresponding to the index through the corresponding pop-up index filtering condition setting window.
Further, if the target switching interface is a screening information configuration interface, before the step "displaying the screening information configuration interface according to the target switching interface", the method further includes:
step a4, detecting whether the update information of the field type in the field information configuration interface is received;
step a5, if yes, acquiring updated field type configuration information, and updating an index field list and a dimension field list in the screening information configuration interface according to the updated field type configuration information;
at this time, the step of displaying the screening information configuration interface according to the target switching interface includes: and displaying the updated screening information configuration interface according to the target switching interface.
Further, if the target switching interface is the screening information configuration interface, before the screening information configuration interface is displayed according to the target switching interface, whether the updating information of the field type in the field information configuration interface is received or not can be detected, if so, the updated field type configuration information is obtained, and the index field list and the dimension field list in the screening information configuration interface are updated according to the updated field type configuration information. That is, the index field list and the dimension field list in the screening information configuration interface are configured based on the configuration of the field type in the field information configuration interface by the user, that is, the field is automatically divided into the index field and the dimension field according to the field type. Generally, fields of numeric type (e.g., default) are divided into pointer fields, and fields of text type (e.g., string, date) are divided into dimension fields. Of course, the specific division manner can be set according to actual conditions. And after the index field list and the dimension field list in the screening information configuration interface are updated, displaying the updated screening information configuration interface according to the target switching interface.
Step S20, receiving a data screening template configuration instruction triggered by a user based on the data screening template configuration interface, and acquiring data screening configuration information carried in the data screening template configuration instruction;
then, when the user clicks a 'completion' button in the screening information configuration interface, the corresponding data screening template configuration instruction is triggered, at this time, the terminal receives the data screening template configuration instruction triggered by the user based on the data screening template configuration interface, and then data screening configuration information carried in the data screening template configuration instruction is obtained. The data filtering configuration information may include, but is not limited to, filtering index information, filtering dimension information, filtering condition information, data set configuration information, service type name, and the like.
Step S30, generating a corresponding data filtering template based on the data filtering configuration information.
And after the data screening configuration information is acquired, generating a corresponding data screening template based on the data screening configuration information. Wherein, the data filtering configuration information includes filtering index information, filtering dimension information and filtering condition information, and step S30 includes:
b1, generating a corresponding first expression according to the target index, the index field, the operation function and the operation symbol in the screening index information;
screening metrics information may include, but is not limited to: the target index is calculated based on the index fields and the operational relationship between the index fields (formed by the operational function and the operational coincidence), for example, for the target index X, the corresponding index fields are A, B and C, and the corresponding first expression is sum (A × B) + avg (C) can be generated by combining the operational function and the operational coincidence. Of course, in a specific embodiment, the user may directly input the first expression of each filtering index at the terminal, and correspondingly, the terminal may directly obtain the information of the filtering index, that is, the information of the filtering index is the first expression corresponding to each filtering index.
Step b2, generating a corresponding second expression according to the target dimension and the dimension field in the screening dimension information,
the screening dimension information may include, but is not limited to: target dimensions and dimension fields, where each target dimension may correspond to one or more dimension fields. For example, for the target dimension W, there are two dimension fields D and E, and a corresponding second expression that can be generated is D + E. Of course, the user may directly input the second expression corresponding to each filtering dimension at the terminal, and correspondingly, the terminal may directly obtain the filtering dimension information, that is, the second expression corresponding to each filtering dimension.
B3, generating a corresponding third expression according to the screening type and the screening information in the screening condition information;
screening condition information may include, but is not limited to: the screening type and the screening information can generate different types of third expressions aiming at different screening types and different screening information, and correspondingly, the third expressions can comprise conditional expressions and constant expressions, wherein the constant expressions can comprise sequence type constants, interval type constants and value corresponding type constants. Specific generation modes of various third expressions are as follows:
(1) the conditional expression is as follows: similar to the dimension expression, it can be composed of condition fields and operation symbols, such as: conditional fields F and G, the conditional expression is configured as F G;
(2) the "constants" in the screening conditions also configure expressions, where the constants include three types: the sequence type constant, the interval type constant and the value corresponding to the type constant, wherein for the expression of the sequence type constant, the following example can be referred to:
for the expression of interval type constants, the following example can be referred to:
{
minor(s) 1,18,
"youth" [19,28] "
}
For an expression where values correspond to type constants, the following example can be referred to:
{
1 part of a male part, namely 1 part of a male part,
0 for women
}
Of course, it can be understood that the user may also directly input the third expression corresponding to each filtering condition at the terminal, and correspondingly, the terminal may directly obtain the information of the filtering condition, that is, the third expression corresponding to each filtering condition.
And b4, obtaining a corresponding data screening template based on the first expression, the second expression and the third expression.
And after a first expression corresponding to the screening index information, a second expression corresponding to the screening dimension information and a third expression corresponding to the screening condition information are obtained, a corresponding data screening template is obtained based on the first expression, the second expression and the third expression.
Further, the data filtering configuration information further includes data set configuration information, and before the step b4, the method further includes:
step b5, determining the type of the selected data set according to the data set configuration information, and detecting whether the type of the selected data set is a preset type;
b6, if the type is a preset type, acquiring input path information in the data set configuration information, and acquiring metadata path information based on the input path information and a preset character string;
step b7, if not, determining the preset path information as the metadata path information;
at this time, step b4 includes: and obtaining a corresponding data screening template based on the first expression, the second expression, the third expression and the metadata path information.
Further, the data filtering configuration information further includes data set configuration information, wherein the data set configuration information may be selectively input based on the data set option shown in fig. 3 (a). For example, if the user clicks the "Hive library table" selection box, the corresponding data set configuration information is: the data set type is Hive library and table; if the user clicks an IDE (Integrated Development Environment) script selection box, a path input box is correspondingly popped up for the user to input the path information of the data set, and the corresponding data set configuration information is as follows: the data set type is IDE script, input path information. And after obtaining the first expression, the second expression and the third expression, determining the type of the selected data set according to the data set configuration information, and detecting whether the type of the selected data set is a preset type, wherein the preset type is an IDE script type, if the type of the selected data set is the preset type, obtaining input path information in the data set configuration information, and obtaining metadata path information based on the input path information and a preset character string, wherein the preset character string is limit 1, and the preset character string can be added at the end of the input path information to obtain the metadata path information. If the type of the selected data set is not the preset type, the preset path information is determined to be metadata path information, namely when the type of the selected data set is a Hive library table, an interface connected with a hiveMetaStore (metadata storage database) can be directly called to directly query corresponding metadata information, and the path information corresponding to the metadata can be set to be the preset path information. After the metadata path information is obtained, a corresponding data screening template is obtained based on the first expression, the second expression, the third expression and the metadata path information. The finally generated data screening template comprises a data set and a wide table which are customized by the user, and indexes, dimensions and screening conditions which are configured by the user and have complicated contents, so that personalized customization can be realized, and the user experience is improved. Meanwhile, a user does not need to export data through an excel table and then manually screen the data, so that the data screening operation process can be simplified, and the data screening efficiency is improved.
The embodiment of the invention provides a data screening method, which comprises the steps of displaying a corresponding data screening template configuration interface when a data screening template configuration request triggered by a user is received; then, receiving a data screening template configuration instruction triggered by a user based on a data screening template configuration interface, and acquiring data screening configuration information carried in the data screening template configuration instruction; and generating a corresponding data screening template based on the data screening configuration information. Compared with the mode of exporting data through an excel form and then manually screening in the prior art, the data screening method and the data screening device do not need manual exporting and screening for multiple times, so that the data screening operation process can be simplified, and the data screening efficiency is improved.
Further, based on the first embodiment, a second embodiment of the data screening method of the present invention is provided.
In this embodiment, before the step S20, the data filtering method further includes:
step A, when an input instruction triggered by a user based on the data screening template configuration interface is detected, acquiring input information and a target input object corresponding to the input instruction;
in this embodiment, after the data filtering template configuration interface is displayed, the user may input related configuration information, such as a service type, a field type, and the like, based on the data filtering template configuration interface, and when the terminal detects an input instruction triggered by the user based on the data filtering template configuration interface, the terminal obtains input information and a target input object corresponding to the input instruction. For example, when the user inputs a field type, the corresponding input information is the input field type, and the target input object is the field type of the target field.
Step B, acquiring an input verification condition corresponding to the target input object, and detecting whether the input information meets the input verification condition;
then, the input verification condition corresponding to the target input object is obtained, and it is detected whether the input information meets the input verification condition, for example, in the above example, for the detection of the field type, the input verification condition corresponding to the field type of the target field may be obtained, for example, for the loan interest rate of the target field, the input verification condition corresponding to the field type is decimal, at this time, it is detected whether the input information (i.e., the input field type) is decimal.
And step C, if the input verification condition is not met, generating corresponding prompt information to prompt a user to input errors.
If the input verification condition is not met, the input error of the user is indicated, and at the moment, corresponding prompt information is generated to prompt the user to input the error.
By the method, when the user inputs information in the data screening template configuration interface, whether the input information meets the requirements or not can be detected, and the user is timely notified to be reminded when the input information does not meet the requirements, so that the user can timely correct the input information.
Further, based on the first embodiment, a third embodiment of the data screening method of the present invention is provided.
In this embodiment, after step S30, the data filtering method further includes:
and D, when a data screening request triggered by a user is received, acquiring a target data screening template from the data screening template according to the data screening request, and screening data according to the target data screening template.
In this embodiment, after the data screening template is generated, the generated data screening template may be stored in a preset database, and during storage, the data screening template may be stored according to a service type name in the data screening template or stored in a serial number, and when a subsequent user needs to use the data screening template for data screening, a data screening request may be triggered in a web page corresponding to the terminal, and at this time, when the terminal receives the data screening request triggered by the user, the terminal obtains a target data screening template from the data screening template according to the data screening request, and performs data screening according to the target data screening template. Specifically, when a user triggers a data screening request, the user may input information such as a service type or a serial number corresponding to a required data screening template, and then the terminal may obtain the service type or the serial number from the data screening request, so as to obtain a target screening template from a preset database according to the service type or the serial number, and then perform data screening based on the target screening template.
In the embodiment, the target data screening template is directly obtained from the generated data screening template for data screening, so that intelligent screening of data can be realized.
The invention also provides a data screening device.
Referring to fig. 4, fig. 4 is a functional block diagram of a data screening apparatus according to a first embodiment of the present invention.
As shown in fig. 4, the data filtering apparatus includes:
the interface display module 10 is configured to display a corresponding data screening template configuration interface when receiving a data screening template configuration request triggered by a user;
the first obtaining module 20 is configured to receive a data screening template configuration instruction triggered by a user based on the data screening template configuration interface, and obtain data screening configuration information carried in the data screening template configuration instruction;
and a template generating module 30, configured to generate a corresponding data screening template based on the data screening configuration information.
Further, the data filtering template configuration interface includes a service information configuration interface, a field information configuration interface, and a filtering information configuration interface, and the interface display module 10 includes:
the first display unit is used for displaying the service information configuration interface when receiving a data screening template configuration request triggered by a user;
the second display unit is used for displaying the field information configuration interface according to a first interface switching instruction triggered by a user based on the service information configuration interface when the first interface switching instruction is received;
and the third display unit is used for determining a target switching interface according to a second configuration interface switching instruction triggered by the user based on the field information configuration interface when the second interface switching instruction is received, and displaying the screening information configuration interface or the service information configuration interface according to the target switching interface.
Further, if the target switching interface is a screening information configuration interface, the interface display module 10 further includes:
the first detection unit is used for detecting whether the updating information of the field type in the field information configuration interface is received or not;
the updating unit is used for acquiring updated field type configuration information and updating an index field list and a dimension field list in the screening information configuration interface according to the updated field type configuration information if the field type configuration information is the same as the index field list;
and the third display unit is specifically used for displaying the updated screening information configuration interface according to the target switching interface.
Further, the data filtering configuration information includes filtering index information, filtering dimension information, and filtering condition information, and the template generating module 30 includes:
the first generating unit is used for generating a corresponding first expression according to a target index, an index field, an operation function and an operation symbol in the screening index information;
a second generating unit, configured to generate a corresponding second expression according to the target dimension and the dimension field in the screening dimension information,
a third generating unit, configured to generate a corresponding third expression according to the screening type and the screening information in the screening condition information;
and the template generating unit is used for obtaining a corresponding data screening template based on the first expression, the second expression and the third expression.
Further, the data filtering configuration information further includes data set configuration information, and the template generating module 30 further includes:
the second detection unit is used for determining the type of the selected data set according to the data set configuration information and detecting whether the type of the selected data set is a preset type;
the acquisition unit is used for acquiring input path information in the data set configuration information if the data set configuration information is a preset type, and acquiring metadata path information based on the input path information and a preset character string;
a determining unit, configured to determine, if the metadata path information is not of a preset type, that preset path information is the metadata path information;
the template generation is specifically configured to: and obtaining a corresponding data screening template based on the first expression, the second expression, the third expression and the metadata path information.
Further, the data screening apparatus further includes:
the second acquisition module is used for acquiring input information and a target input object corresponding to an input instruction when the input instruction triggered by a user based on the data screening template configuration interface is detected;
the third detection module is used for acquiring an input verification condition corresponding to the target input object and detecting whether the input information meets the input verification condition;
and the error prompt module is used for generating corresponding prompt information to prompt a user to input an error if the input verification condition is not met.
Further, the data screening apparatus further includes:
and the data screening module is used for acquiring a target data screening template from the data screening templates according to the data screening request and screening data according to the target data screening template when receiving a data screening request triggered by a user.
The function implementation of each module in the data screening apparatus corresponds to each step in the data screening method embodiment, and the function and implementation process thereof are not described in detail herein.
The present invention also provides a computer readable storage medium having stored thereon a data screening program which, when executed by a processor, implements the steps of the data screening method according to any one of the above embodiments.
The specific embodiment of the computer-readable storage medium of the present invention is substantially the same as the embodiments of the data screening method described above, and is not described herein again.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) as described above and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. A data screening method is applied to a web page, and comprises the following steps:
when a data screening template configuration request triggered by a user is received, displaying a corresponding data screening template configuration interface;
receiving a data screening template configuration instruction triggered by a user based on the data screening template configuration interface, and acquiring data screening configuration information carried in the data screening template configuration instruction;
and generating a corresponding data screening template based on the data screening configuration information.
2. The data screening method of claim 1, wherein the data screening template configuration interface includes a service information configuration interface, a field information configuration interface, and a screening information configuration interface, and the step of displaying the corresponding data screening template configuration interface when receiving a data screening template configuration request triggered by a user includes:
when a data screening template configuration request triggered by a user is received, displaying the service information configuration interface;
when a first interface switching instruction triggered by a user based on the service information configuration interface is received, displaying the field information configuration interface according to the first interface switching instruction;
and when a second interface switching instruction triggered by the user based on the field information configuration interface is received, determining a target switching interface according to the second configuration interface switching instruction, and displaying the screening information configuration interface or the service information configuration interface according to the target switching interface.
3. The data screening method of claim 2, wherein if the target switching interface is a screening information configuration interface, the step of displaying the screening information configuration interface according to the target switching interface further comprises, before the step of displaying the screening information configuration interface according to the target switching interface:
detecting whether updating information of the field type in the field information configuration interface is received;
if so, acquiring updated field type configuration information, and updating an index field list and a dimension field list in the screening information configuration interface according to the updated field type configuration information;
the step of displaying the screening information configuration interface according to the target switching interface comprises the following steps:
and displaying the updated screening information configuration interface according to the target switching interface.
4. The data screening method of any one of claims 1 to 3, wherein the data screening configuration information includes screening index information, screening dimension information, and screening condition information, and the step of generating the corresponding data screening template based on the data screening configuration information includes:
generating a corresponding first expression according to a target index, an index field, an operation function and an operation symbol in the screening index information;
generating a corresponding second expression according to the target dimension and the dimension field in the screening dimension information,
generating a corresponding third expression according to the screening type and the screening information in the screening condition information;
and obtaining a corresponding data screening template based on the first expression, the second expression and the third expression.
5. The data screening method of claim 4, wherein the data screening configuration information further includes data set configuration information, and before the step of obtaining the corresponding data screening template based on the first expression, the second expression, and the third expression, the method further includes:
determining the type of the selected data set according to the data set configuration information, and detecting whether the type of the selected data set is a preset type;
if the type is a preset type, acquiring input path information in the data set configuration information, and acquiring metadata path information based on the input path information and a preset character string;
if the metadata path information is not the preset type, determining that the preset path information is the metadata path information;
the step of obtaining the corresponding data screening template based on the first expression, the second expression and the third expression comprises:
and obtaining a corresponding data screening template based on the first expression, the second expression, the third expression and the metadata path information.
6. The data screening method of any one of claims 1 to 3, wherein prior to the step of receiving a data screening template configuration instruction triggered by a user based on the data screening template configuration interface, the data screening method further comprises:
when an input instruction triggered by a user based on the data screening template configuration interface is detected, acquiring input information and a target input object corresponding to the input instruction;
acquiring an input verification condition corresponding to the target input object, and detecting whether the input information meets the input verification condition;
and if the input verification condition is not met, generating corresponding prompt information to prompt the user to input errors.
7. The data screening method of any one of claims 1 to 3, wherein after the step of generating a corresponding data screening template based on the data screening configuration information, the data screening method further comprises:
and when a data screening request triggered by a user is received, acquiring a target data screening template from the data screening template according to the data screening request, and screening data according to the target data screening template.
8. A data screening apparatus, applied to a web page, the data screening apparatus comprising:
the interface display module is used for displaying a corresponding data screening template configuration interface when receiving a data screening template configuration request triggered by a user;
the first acquisition module is used for receiving a data screening template configuration instruction triggered by a user based on the data screening template configuration interface and acquiring data screening configuration information carried in the data screening template configuration instruction;
and the template generating module is used for generating a corresponding data screening template based on the data screening configuration information.
9. A data screening apparatus, characterized in that the data screening apparatus comprises: memory, a processor and a data filter stored on the memory and executable on the processor, the data filter when executed by the processor implementing the steps of the data filtering method of any one of claims 1 to 7.
10. A computer-readable storage medium, having stored thereon a data screening program which, when executed by a processor, implements the steps of the data screening method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911065021.0A CN110780970B (en) | 2019-10-30 | 2019-10-30 | Data screening method, device, equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911065021.0A CN110780970B (en) | 2019-10-30 | 2019-10-30 | Data screening method, device, equipment and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110780970A true CN110780970A (en) | 2020-02-11 |
| CN110780970B CN110780970B (en) | 2024-06-14 |
Family
ID=69388781
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911065021.0A Active CN110780970B (en) | 2019-10-30 | 2019-10-30 | Data screening method, device, equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110780970B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112286979A (en) * | 2020-10-30 | 2021-01-29 | 北京明略软件系统有限公司 | Data screening method and device, electronic equipment and storage medium |
| CN113312053A (en) * | 2020-02-27 | 2021-08-27 | 北京沃东天骏信息技术有限公司 | Data processing method and device |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103514206A (en) * | 2012-06-26 | 2014-01-15 | 百度在线网络技术（北京）有限公司 | Method and device for determining popularization configuration information corresponding to objective popularization object |
| US20150294005A1 (en) * | 2012-12-27 | 2015-10-15 | Tencent Technology (Shenzhen) Company Limited | Method and device for acquiring information |
| CN106682150A (en) * | 2016-12-22 | 2017-05-17 | 北京锐安科技有限公司 | Information processing method and device |
| CN108647339A (en) * | 2018-05-14 | 2018-10-12 | 五八有限公司 | A kind of dimensionality analysis method, apparatus, equipment and storage medium |
| CN109359280A (en) * | 2018-09-12 | 2019-02-19 | 深圳市随手科技有限公司 | Method for exhibiting data, device, computer equipment and storage medium |
| CN109656980A (en) * | 2018-12-27 | 2019-04-19 | Oppo（重庆）智能科技有限公司 | Data processing method, electronic equipment, device and readable storage medium storing program for executing |
| CN109840303A (en) * | 2019-01-02 | 2019-06-04 | 平安科技（深圳）有限公司 | Original list method for customizing, device, equipment and computer readable storage medium |
-
2019
- 2019-10-30 CN CN201911065021.0A patent/CN110780970B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103514206A (en) * | 2012-06-26 | 2014-01-15 | 百度在线网络技术（北京）有限公司 | Method and device for determining popularization configuration information corresponding to objective popularization object |
| US20150294005A1 (en) * | 2012-12-27 | 2015-10-15 | Tencent Technology (Shenzhen) Company Limited | Method and device for acquiring information |
| CN106682150A (en) * | 2016-12-22 | 2017-05-17 | 北京锐安科技有限公司 | Information processing method and device |
| CN108647339A (en) * | 2018-05-14 | 2018-10-12 | 五八有限公司 | A kind of dimensionality analysis method, apparatus, equipment and storage medium |
| CN109359280A (en) * | 2018-09-12 | 2019-02-19 | 深圳市随手科技有限公司 | Method for exhibiting data, device, computer equipment and storage medium |
| CN109656980A (en) * | 2018-12-27 | 2019-04-19 | Oppo（重庆）智能科技有限公司 | Data processing method, electronic equipment, device and readable storage medium storing program for executing |
| CN109840303A (en) * | 2019-01-02 | 2019-06-04 | 平安科技（深圳）有限公司 | Original list method for customizing, device, equipment and computer readable storage medium |
Non-Patent Citations (2)
| Title |
|---|
| DAVID B. FLORA ET AL.: "Old and New Ideas for Data Screening and Assumption Testing for Exploratory and Confirmatory Factor Analysis", QUANTITATIVE PSYCHOLOGY AND MEASUREMENT, 31 March 2012 (2012-03-31) * |
| 唐磊: "基于数据仓库的社保统计分析系统的设计与实现", 中国优秀硕士学位论文全文数据库信息科技辑, vol. 2018, no. 09, 15 September 2018 (2018-09-15), pages 138 - 153 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113312053A (en) * | 2020-02-27 | 2021-08-27 | 北京沃东天骏信息技术有限公司 | Data processing method and device |
| CN112286979A (en) * | 2020-10-30 | 2021-01-29 | 北京明略软件系统有限公司 | Data screening method and device, electronic equipment and storage medium |
| CN112286979B (en) * | 2020-10-30 | 2024-01-30 | 北京明略软件系统有限公司 | Data screening method and device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110780970B (en) | 2024-06-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108228169B (en) | Chart making method, device, equipment and medium based on eCharts tool | |
| US11645046B2 (en) | Systems and methods for development and deployment of software platforms having advanced workflow and event processing components | |
| US20210034336A1 (en) | Executing a process-based software application in a first computing environment and a second computing environment | |
| US6973625B1 (en) | Method for creating browser-based user interface applications using a framework | |
| CN109074549A (en) | Application with embedded workflow designer | |
| CN112540763A (en) | Front-end page generation method and device, platform equipment and storage medium | |
| US20120136684A1 (en) | Fast, dynamic, data-driven report deployment of data mining and predictive insight into business intelligence (bi) tools | |
| US20130152038A1 (en) | Project management workflows | |
| US10135800B2 (en) | Electronic discovery insight tool | |
| US11422783B2 (en) | Auto-deployment of applications | |
| US11556702B2 (en) | Orchestration of crud operations for a hierarchical web service data model in a spreadsheet | |
| CN114036443A (en) | Page generation method and device | |
| CN111190905A (en) | Database table processing method and device and electronic equipment | |
| CN110780970B (en) | Data screening method, device, equipment and computer readable storage medium | |
| US9529843B2 (en) | Highly portable and dynamic user interface component to specify and perform simple to complex filtering on data using natural language-like user interface | |
| US20140143701A1 (en) | Visualizing related business activities in an interactive timeline | |
| KR101910179B1 (en) | Web-based chart library system for data visualization | |
| US11848976B2 (en) | Custom action invocation in a speadsheet integrated with web services | |
| CN115469849B (en) | Service processing system, method, electronic equipment and storage medium | |
| CN110597812B (en) | Menu configuration method, device, terminal and readable storage medium | |
| US8924420B2 (en) | Creating logic using pre-built controls | |
| US20240037325A1 (en) | Ability to add non-direct ancestor columns in child spreadsheets | |
| CN114072787A (en) | System and method for fast data entry to facilitate document review | |
| US20230334395A1 (en) | Automated code generation for data transformations in a workflow | |
| CN111221610B (en) | Page element acquisition method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |