CN111736837B - Method, device, device, readable storage medium, and system for restoring web page operations - Google Patents

Abstract

Embodiments of the present application provide a method, system, device, device, and readable storage medium for restoring web page operations. In response to querying the element identifier in the information to be restored, the robot performs the operation on the target element with the element identifier in the web page. The operation indicated by the operation information of the target element. In response to finding the recursive path in the information to be restored, the operation indicated by the operation information of the target element is performed on the target element with the recursive path in the webpage. Compared with the method of searching for the target element by traversing from the root node in the prior art, the method can directly locate the target element according to the element identifier of the target element, and according to the recursive path of the target element, start from the leaf node and expand the positioning target to the root node. element. The method avoids the disadvantages of the prior art, such as long time consuming, low efficiency, and inability to obtain all the target elements in the complex page scene.

Description

Method, device, device, readable storage medium, and system for restoring web page operations

technical field

The present application relates to the field of electronic information, and in particular, to a method, apparatus, device, readable storage medium and system for restoring web page operations.

Background technique

The implementation of AI (Artificial Intelligence, artificial intelligence) technology and the increase in labor costs are the catalysts for the development of process automation. Process automation is not only developing faster and faster, but also has more and more application scenarios, and process automation products are emerging. frenzy. RPA (Robotic Process Automation), translated as process automation robot, is a kind of intelligent software that realizes the automation of workflow by simulating and enhancing the interaction process between humans and computers.

When the existing RPA restores the operation process of the web page, it is not only prolonged when there are a large number of elements on the web page, but also for complex web pages with many nested HTML, because the elements of the nested HTML cannot be obtained. , therefore, it is impossible to accurately restore the operation of people on the web page.

It can be seen that how to reduce the delay of restoring the webpage operation and improve the accuracy has become an urgent problem to be solved at present.

SUMMARY OF THE INVENTION

The present application provides a method, device, device, readable storage medium and system for restoring a webpage operation, which aim to reduce the delay of restoring a webpage operation and improve the accuracy.

In order to achieve the above purpose, the application provides the following technical solutions:

A method for restoring web page operations, comprising:

Obtain information to be restored, the information to be restored includes attribute information and operation information of a target element, the target element is an element operated by a person in a web page, the attribute information is used to indicate the attribute of the target element, and the operation information Used to indicate the operation performed by the person on the target element, the attribute information includes at least one of an element identifier, a recursive path and a traversal path, where the recursive path is a path that starts from a leaf node and extends to a root node , the traversal path is a path extending from the root node to the leaf node;

In response to querying the element identifier in the information to be restored, perform the operation indicated by the operation information of the first target element on the first target element in the webpage; the target element identified by the element;

In response to querying the recursive path in the information to be restored, perform the operation indicated by the operation information of the second target element on the second target element in the webpage; the second target element is, the target element indicated by the leaf node in the recursive path.

Optionally, also include:

In response to not finding the element identifier and the recursive path in the information to be restored, perform the operation indicated by the operation information of the third target element on the third target element in the webpage; The three target elements are the target elements indicated by the last preset character string in the traversal path.

Optionally, performing the operation indicated by the operation information includes at least one of the following:

The operation indicated by the operation information is performed by calling the encapsulation function of the mouse interface and/or the keyboard interface in the FIaUI library.

Optionally, obtain the information to be restored, including:

The information to be restored is received, wherein the attribute information and operation information of the target element are acquired automatically and/or through human-computer interaction.

Optionally, in response to querying the element identifier in the information to be restored, for the first target element in the webpage, performing the operation indicated by the operation information of the first target element, including:

In the absence of a custom restoration rule, in response to querying the element identifier in the to-be-restored information, for the first target element in the webpage, perform the operation indicated by the operation information of the first target element. operate;

In response to querying the recursive path in the information to be restored, performing the operation indicated by the operation information of the second target element on the second target element in the webpage, including:

In the case where the custom restoration rule does not exist, in response to querying the recursive path in the information to be restored, for the second target element in the webpage, perform operation information on the second target element the indicated operation;

The method also includes:

In the presence of the custom restoration rule, the target element is operated according to the custom restoration rule.

A restoration device for webpage operation, comprising:

An information acquisition unit is used to acquire information to be restored, the information to be restored includes attribute information and operation information of a target element, the target element is an element operated by a person in a web page, and the attribute information is used to indicate the attribute information of the target element. attribute, the operation information is used to indicate the operation performed by the person on the target element, the attribute information includes at least one of an element identifier, a recursive path and a traversal path, and the recursive path starts from a leaf node, a path extending to the root node, the traversal path is a path extending from the root node to the leaf node;

a first operation unit, configured to perform the operation indicated by the operation information of the first target element on the first target element in the webpage in response to the element identifier in the information to be restored; the The first target element is the target element with the element identifier;

a second operation unit, configured to perform the operation indicated by the operation information of the second target element on the second target element in the webpage in response to the recursive path in the information to be restored being queried; the The second target element is the target element indicated by the leaf node in the recursive path.

A restoration device for webpage operation, comprising: a memory and a processor;

the memory for storing programs;

The processor is configured to execute the program to implement each step of the above-mentioned method for restoring a webpage operation.

A readable storage medium on which a computer program is stored, characterized in that, when the computer program is executed by a processor, each step of the method for restoring a web page operation as described above is implemented.

A restoration system for webpage operations, comprising:

Designers, robots and management control platforms;

The designer is used to obtain the information to be restored, and send the information to be restored to the management control platform; the information to be restored includes attribute information and operation information of a target element, and the target element is operated by a person on a webpage element, the attribute information is used to indicate the attribute of the target element, the operation information is used to indicate the operation performed by the person on the target element, and the attribute information includes an element identifier, a recursive path and a traversal path. At least one item, the recursive path is a path that starts from a leaf node and extends to a root node, and the traversal path is a path that starts from the root node and extends to the leaf node;

The management control platform is used for sending the information to be restored to the robot;

The robot is configured to, in response to querying the element identifier in the information to be restored, perform the operation indicated by the operation information of the first target element on the first target element in the webpage; A target element is the target element with the element identifier;

In response to querying the recursive path in the information to be restored, perform the operation indicated by the operation information of the second target element on the second target element in the webpage; the second target element is, the target element indicated by the leaf node in the recursive path.

Optionally, the management control platform is also used for at least one of the following:

Sending a heartbeat message to the robot, the heartbeat message is used for the robot to maintain a heartbeat consistent with the management control platform;

Monitor the status of the robot.

A method, device, device, readable storage medium and system for restoring a webpage operation described in the present application obtains information to be restored, and the information to be restored includes attribute information and operation information of a target element, wherein the target element is a person in the webpage The element of the operation, the attribute information is used to indicate the attribute of the target element, the operation information is used to indicate the operation performed by a person on the target element, and the attribute information includes at least one of an element identifier, a recursive path and a traversal path. In response to querying the element identifier in the information to be restored, the operation indicated by the operation information of the target element is performed on the target element with the element identifier in the web page. In response to querying the recursive path in the information to be restored, the operation indicated by the operation information of the target element is performed on the target element with the recursive path in the webpage. Compared with the method of searching for the target element by traversing from the root node in the prior art, the target element can be directly located according to the element identifier of the target element, thereby reducing the time delay of restoring the webpage. Moreover, according to the recursive path of the target element, starting from the leaf node and extending the positioning target element to the root node, the disadvantage of the prior art that all target elements cannot be obtained in the scenario of complex HTML pages with many nests is avoided. To sum up, the method reduces the time delay of restoring the web page operation and improves the restoration accuracy of the web page operation.

Description of drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the accompanying drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present application. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings without any creative effort.

FIG. 1 is a schematic structural diagram of a system for restoring web page operations according to an embodiment of the present application;

2 is a schematic flowchart of a specific implementation of a method for restoring web page operations provided by an embodiment of the present application;

3 is a service system architecture diagram of a process automation platform provided by an embodiment of the present application;

4 is a schematic flowchart of a method for restoring a webpage operation provided by an embodiment of the present application;

FIG. 5 is a schematic structural diagram of an apparatus for restoring web page operations provided by an embodiment of the present application;

FIG. 6 is a schematic structural diagram of a device for restoring web page operations according to an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

A method for restoring a webpage operation provided by an embodiment of the present application implements an accurate restoration of a person's operation on a webpage based on a webpage operation restoring system. FIG. 1 is a system for restoring a webpage operation provided by an embodiment of the present application. As shown in FIG. 1 , the restoring system for a webpage operation includes a designer, a robot, and a management control platform.

FIG. 2 is a specific implementation process of a method for restoring a web page operation through interaction between components in a web page operating system provided by an embodiment of the present application, as shown in FIG. 2 , and specifically includes the following steps:

S201, the designer obtains the information to be restored.

In this embodiment, the information to be restored includes attribute information and operation information of the target element, and the target element is an element operated by a person in the webpage.

In this embodiment, a human-computer interaction module, that is, an element selector, is set in the designer. In practical applications, a person (that is, a user, which can be a pre-registered account) triggers the selection instruction of the element selector, and the element selector obtains and saves it to be restored. information. It should be noted that the way the element selector saves the information to be restored is to save the json array including the target element, and the way the element selector saves the json array is: starting from the root node of the HTML of the web page, and saving it layer by layer until the leaf node , each layer is a json string. Taking the Baidu input box as an example, the first json array is information such as the url of the web page. In this embodiment, when elements are matched, the first json array is skipped, and the matching starts from the HTML root node.

In this embodiment, the element selector includes two optional modes for selecting information to be restored, the first mode is an automatic mode, and the second mode is a human-computer interaction mode. This embodiment introduces the trigger conditions and selection process of the two modes, as follows:

First, in automatic mode, the designer automatically obtains the information to be restored through the element selector.

Specifically, in response to the user's instruction to open the element selector, the designer pops up the selection window of the element selector, selects the preset selection button of the window, and hides the selection window of the selector when the user clicks the selection button. When the element that needs to be operated is clicked, the element selector automatically obtains the element operated by the user in the web page (recorded as the target element), and automatically parses the information of the web page into a json array and saves it, thus completing the acquisition of the target element once, and then again The click window of the selector pops up, and the above operations are repeated until all elements operated by the user in the web page are automatically obtained.

It should be noted that the click operation generally refers to a mouse click. In the first mode, the user only needs a simple click operation, and the element selector can automatically obtain the element operated by the user in the web page, that is, the target element.

It should be further noted that after the designer automatically obtains the information to be restored, it is saved and displayed in a json array, which is displayed in a tree diagram structure, and the target element is highlighted.

Second, in the human-computer interaction mode, the designer obtains the information to be restored through the interaction between the element selector and the user.

In response to the user's instruction to open the element selector, the designer pops up a selection window of the element selector, and the selection window displays each element in the web page in a tree structure. When the user queries layer by layer in the tree diagram and clicks to select an element that is manually operated on the web page, the element selector obtains the clicked element as the target element and identifies it with a highlight.

It should be noted that there are many types of web frameworks and complex web pages. In this embodiment, the information to be restored is obtained through the human-computer interaction mode, which can improve the accuracy of the information to be restored.

It should be noted that, in the information to be restored obtained in the above two modes, the attribute information of the target element is used to indicate the attribute of the target element, the operation information is used to indicate the operation performed by a person on the target element, and the attribute information includes the element identifier, the recursive path. and traverse the path.

Wherein, when the attribute information of the target element includes the element identifier, the element selector obtains the element identifier of the target element, and saves it in the json array as the information to be restored.

A recursive path starts from a leaf node and extends to the root node. When the attribute information of the target element includes the recursive path, the element selector obtains the recursive path of the target element, and saves the recursive path of the target element as the information to be restored to the json array. At this time, the element selector does not need to save the full path of the target element Information.

The traversal path is the path that starts from the root node and extends to the leaf nodes (that is, the full path). When the attribute information of the target element includes the traversal path, the element selector obtains the traversal path of the target element, and uses the traversal path of the target element as the waiting path. The restore information is saved to a json array.

It should be noted that the attribute information of the target element includes at least one of an element identifier, a recursive path, and a traversal path.

S202, the designer sends the information to be restored to the management control platform.

S203, the management control platform sends the information to be restored to the robot.

S204 , the robot queries whether there is a custom restoration rule, and if there is no custom restoration rule, execute S205 to S207 , and if there is a custom restoration rule, execute S208 .

In this embodiment, the custom restoration rule is a preset personalized restoration rule, which is customized by the user according to actual needs and integrated into the element selector.

S205. Whether the information to be restored obtained by the robot query includes the element identifier of the target element.

If so, in response to querying the element identifier in the information to be restored, the robot performs the operation indicated by the operation information of the first target element on the target element with the element identifier (referred to as the first target element) in the webpage.

It should be noted that MSHTML provides seven HTML document interfaces, and encapsulates various methods of document into HTMLDocument. When the attribute information of the target element includes the element identifier, the element selector will obtain the element identifier of the target element, save it in the json array as the information to be restored, and send the information to be restored to the robot through the management control platform. In this step, the robot receives the information to be restored, queries the element identifier of the target element from the information to be restored, and executes the operation indicated by the operation information according to the operation information of the target element. Optionally, the robot calls getElementById() in the HTMLDocument interface. method to perform the operation indicated by the operation information.

In this embodiment, the operation indicated by the operation information of the first target element by the robot may include general operations, such as an assignment operation, a click operation, and a selection operation. Among them, the assignment uses the value (assignment) attribute of the first target element, the click is to trigger the click (click) event, and the selection is to trigger the select (selection) event. Generally, the general operation can be encapsulated, and the operation requirement of the robot on the first target element can be satisfied by calling the encapsulation function. In this embodiment, in order to better simulate human-computer interaction and restore human operations on the first target element, the mouse interface and the keyboard interface are encapsulated in advance, and the encapsulation function is saved.

In this embodiment, the mouse interface is encapsulated, so that a mouse click operation can trigger a click event, and also trigger a mousedown event, a mouseup event, a left-click event, and a right-click event.

For the assignment operation, most of the input boxes can directly assign values to the attributes of the first target element, but at least one of the following problems (1) to (3) exists.

(1) The password input in the input box (such as the login box) cannot be directly assigned.

(2) The input box can be assigned a value, but if the correct password is entered, the password error will be displayed when logging in.

(3) The assignment of the input box cannot trigger the fuzzy query.

In this embodiment, the keyboard interface is encapsulated, so that the keyboard input operation can trigger the related events after assignment. To solve the above problem (1) ~ problem (3). For example, the keyboard interface is encapsulated so that the assignment of a preset type of input box (such as a drop-down box) triggers a fuzzy query, so that a keyboard input operation can trigger an assignment operation.

It should be noted that FlaUI is a UI automation library, which calls the encapsulation functions of the mouse interface and the keyboard interface, and can simulate the operation of the keyboard and mouse. Therefore, in this embodiment, the robot performs the operation indicated by the operation information of the first target element by calling the encapsulation function of the mouse interface and/or the keyboard interface in the FIaUI library.

S206 , if the element identifier of the target element is not queried, the robot queries whether the information to be restored that is acquired includes the recursive path of the target element.

If so, the robot performs the operation indicated by the operation information of the second target element on the second target element in the webpage in response to the recursive path in the information to be restored in response to the query. The second target element is the target element indicated by the leaf node in the recursive path.

In this embodiment, the recursive path is a path that starts from a leaf node and extends to the root node. When the robot responds to the recursive path of the second target element, it first recurses to the leaf node. If the leaf node matches, then matches the parent node of the leaf node. At this time, the index of the json array is reduced by 1, and the unmatched nodes are pruned. Until the target element indicated by the leaf node in the recursive path is matched, at this time, the information check is all passed, and the final leaf node is the second target element that needs to be operated.

It should be noted that the robot performs the operation indicated by the operation information of the second target element by calling the encapsulation function of the mouse interface and/or the keyboard interface in the FIaUI library. For a specific implementation process, reference may be made to the above S205.

S207. If the recursive path of the target element is not queried, the robot performs the operation indicated by the operation information of the third target element on the third target element in the webpage.

Specifically, since the information to be restored includes at least one of the element identifier of the target element, the recursive path, or the traversal path, when the above-mentioned robot queries the information to be restored, the element in the information to be restored is not queried. When identifying and recursive path, the robot performs the operation indicated by the operation information of the third target element on the third target element in the webpage in response to not finding the element identifier and recursive path in the information to be restored. In this embodiment, the traversal path is a path extending from the root node to the leaf nodes, and the third target element is the target element indicated by the last preset character string in the traversal path.

For example, the robot starts from the root node, filters the child nodes through the traversal path of the third target element, and finds the matching child node through attributes such as tagName, className, id, IndexInParent, etc. At this time, the index of the json array is increased by 1, and then continues to match the child The child nodes of the node, and so on, until the target element indicated by the last preset string in the traversal path is matched. At this time, all the information checking is passed, and the final child node, that is, the leaf node, is the third target element that needs to be operated.

It should be noted that the robot performs the operation indicated by the operation information of the third target element by calling the encapsulation function of the mouse interface and/or the keyboard interface in the FIaUI library. For a specific implementation process, reference may be made to the above S205.

S208 , in the presence of a custom restoration rule, operate on the target element according to the custom restoration rule.

Because the web system has many frameworks and frequent update iterations, version updates may cause usage problems. For example, the Ext.js framework has an Id attribute for the elements in the encapsulated component, and the Id is dynamically and randomly assigned. When the window or web page is closed and reopened, the Id will be dynamically assigned again. The two Ids are different before and after, so in the element During attribute verification, the Id attribute match will be removed artificially, but due to the large number of web page elements, the efficiency is too low, so customized development is required.

In order to avoid the problem of increased communication cost or low efficiency caused by customized development. In this embodiment, the method of customized development is integrated into the element selector as a customized restoration rule. When a custom restoration rule is set in the element selector, the user converts the elements operated on the web page and the operations on the elements into JavaScript and uses them as an incoming parameter in the element selector. When the process is executed, RPA will A segment of JavaScript is embedded directly into the browser for execution.

Based on the custom restoration rules, when the adjacent elements of the target element have fixed element identifiers, the robot can quickly locate the target element that people operate in the web page through the ParentNode or Children method, and operate the target element according to the custom restoration rules. . In this embodiment, the robot can view the listening event of the target element through the Chrome browser, and directly call it with JavaScript embedded in the browser.

It can be seen from the above technical solutions that in the method for restoring web page operations provided by the embodiments of the present application, the designer obtains and saves the information to be restored, wherein the information to be restored includes the attribute information and operation information of the target element, and the to-be-restored information is restored through the management control platform. The restoration information is sent to the robot, and the robot performs the operation indicated by the operation information on the target element according to the attribute information of the target element in the queried information to be restored.

For the prior art, the analysis of the beneficial effects of the method for restoring web page operations provided by the embodiments of the present application is as follows:

First, in the method for restoring a webpage operation provided by the embodiment of the present application, the operation indicated by the operation information of the target element is directly performed on the target element with the element identifier in the webpage. There is no need to traverse all nodes, which improves the efficiency of restoration.

For example, when there are many HTML elements in a website, it takes a lot of time to use the Children property of the IHTMLElement interface when traversing nodes in the prior art. Each time the Children property is called, it takes hundreds of milliseconds. If the number of element layers is 50, then Causes it to take half a minute to find the element. When the attribute information of the target element includes the element identifier, the method directly calls the getElementById() method in the HTMLDocument interface and executes the operation indicated by the operation information, which greatly improves the restoration efficiency of the operation of complex webpage elements.

Second, in the method for restoring a webpage operation provided by the embodiment of the present application, an operation indicated by the operation information of the target element is performed on a target element with a recursive path in the webpage. There is no need to traverse all nodes, which improves the efficiency of restoration.

For example, there is nested HTML in practical applications, and the existing technology directly traverses from the root node, and the elements in the nested HTML cannot be obtained. With the method for matching according to the recursive path provided in this embodiment, recursive matching is performed from the leaf node to the root node, which solves the disadvantage that the root node traversal method cannot obtain all elements.

Third, in the method for restoring web page operations provided by the embodiments of the present application, customizing custom restoration rules is supported, and elements operated in web pages and operations on elements are converted into JavaScript and used as an incoming parameter in the element selector, Avoid the problems of increased communication costs or low efficiency caused by customized development in the existing technology.

Fourth, in the method for restoring a webpage operation provided by the embodiment of the present application, the mouse interface in the FlaUI framework is used to realize the movement and click of the mouse, simulating the real operation of a person. It overcomes the disadvantage that in the prior art, the scene of the click event can only trigger the click, and the operation events such as mousedown and mouseup cannot be triggered.

Fifth, in the method for restoring web page operations provided by the embodiments of the present application, the Keyboard interface in the FlaUI framework is used to simulate the operation of human input through the keyboard. Function. It overcomes the disadvantage that the element assignment operation cannot directly assign an element in the prior art.

To sum up, the method for restoring web page operations provided in this embodiment effectively solves the problems of inaccuracy, slow speed, inability to trigger events, and low efficiency caused by customized design of web elements by browsers.

It should be noted that the restoration system for webpage operations provided by the embodiments of the present application is developed based on MSHTML components. It should be noted that MSHTML is a typesetting engine of a browser (IE) carried by Microsoft Windows. Specifically, MSHTML encapsulates the HTML language All elements and their attributes in the HTML language can be manipulated through the interface provided by MSHTML.

The restoration system for webpage operation shown in FIG. 1 may also have the following functions for description. as follows:

The management control platform is also used to send a heartbeat message to the robot. The heartbeat message is used for the robot to maintain a heartbeat consistent with the management and control platform, and to receive operation logs fed back by the robot, to monitor the robot's own state and the execution state of the process. In this embodiment, the management control platform is also used to feed back status information to the client (pre-registered account).

It should be noted that the restoration system for web page operations can also perform an authentication or verification process.

Specifically, the designer receives a login request in response to the user, provides a login window, and receives user information input by the user, such as account information and password information, the designer sends the user information to the management control platform, and the management control platform is based on the registration information, Validate user information and feed back the validation information to the designer.

In this embodiment, the certificate management service of the designer and the robot is responsible for the preset certificate management service in the management control platform, as shown in FIG. 3 , which shows the architecture of a process automation platform, wherein the right side of FIG. 3 A service system architecture diagram of the RPA certificate management service is shown.

It should be noted that, the specific implementation process of the method for restoring a webpage operation in the example of FIG. 2 is only an optional method for restoring a webpage operation. This embodiment may also have other specific implementation manners for realizing the restoration of web page operations. For example, in this embodiment, by calling the encapsulation function of the mouse interface and/or the keyboard interface in the FIaUI library to perform the operation indicated by the operation information, it is only a way to perform the operation indicated by the operation information, and other existing ones can also be used. way to achieve.

To sum up, in this embodiment, the operation of restoring a webpage by a robot is summarized as the method shown in FIG. 4 . As shown in FIG. 4 , the method for restoring a webpage operation of a robot includes the following steps.

S401. Obtain information to be restored.

The information to be restored includes attribute information and operation information of the target element. The target element is an element operated by a person on the webpage. The attribute information is used to indicate the attribute of the target element, and the operation information is used to indicate the operation performed by the person on the target element.

The attribute information includes at least one of an element identifier, a recursive path and a traversal path. The recursive path is a path that starts from a leaf node and extends to the root node, and the traversal path is a path that starts from the root node and extends to the leaf node.

It should be noted that the information to be restored is obtained by the designer and sent to the robot through the management control platform. For details, refer to the above-mentioned embodiments.

S402. In response to querying the element identifier in the information to be restored, perform the operation indicated by the operation information of the first target element on the first target element in the webpage.

In this embodiment, the first target element is a target element with an element identifier. For details, reference may be made to the above S205, which is not repeated here.

S403. In response to querying the recursive path in the information to be restored, perform the operation indicated by the operation information of the second target element on the second target element in the webpage.

In this embodiment, the second target element is the target element indicated by the leaf node in the recursive path. For details, reference may be made to the above S206, which is not repeated here.

It can be seen from the above technical solutions that in the method for restoring web page operations provided by the embodiments of the present application, the robot, in response to querying the element identifier in the information to be restored, performs the operation information of the target element on the target element with the element identifier in the web page. the indicated action. In response to querying the recursive path in the information to be restored, the operation indicated by the operation information of the target element is performed on the target element with the recursive path in the webpage. Compared with the method of searching for the target element by traversing from the root node in the prior art, the method can directly locate the target element according to the element identifier of the target element, thereby reducing the time delay of restoring the webpage. Moreover, according to the recursive path of the target element, the method starts from the leaf node and extends to the root node to locate the target element, thereby avoiding the disadvantage that all the target elements cannot be obtained in the complex page scene in the prior art. To sum up, the method reduces the time delay of restoring the webpage operation, and improves the accuracy and efficiency of restoring the webpage operation.

FIG. 5 is a schematic structural diagram of an apparatus for restoring web page operations provided by an embodiment of the present application. As shown in FIG. 5 , the apparatus includes:

The information acquisition unit 501 is configured to acquire information to be restored, the information to be restored includes attribute information and operation information of a target element, the target element is an element operated by a person in a web page, and the attribute information is used to indicate the target element attribute, the operation information is used to indicate the operation performed by the person on the target element, the attribute information includes at least one of an element identifier, a recursive path and a traversal path, and the recursive path starts from a leaf node , a path extending to the root node, and the traversing path is a path extending from the root node to the leaf node;

The first operation unit 502 is configured to, in response to querying the element identifier in the information to be restored, perform the operation indicated by the operation information of the first target element on the first target element in the webpage; The first target element is the target element with the element identifier;

The second operation unit 503 is configured to, in response to querying the recursive path in the information to be restored, perform the operation indicated by the operation information of the second target element on the second target element in the webpage; The second target element is the target element indicated by the leaf node in the recursive path.

Optionally, the device further includes a third operation unit, and the third operation unit is used for:

In response to not finding the element identifier and the recursive path in the information to be restored, perform the operation indicated by the operation information of the third target element on the third target element in the webpage; The three target elements are the target elements indicated by the last preset character string in the traversal path.

Optionally, the first operation unit or the second operation unit performs the operation indicated by the operation information, including at least one of the following:

The first operating unit or the second operating unit is specifically used for:

The operation indicated by the operation information is performed by calling the encapsulation function of the mouse interface and/or the keyboard interface in the FIaUI library.

The information acquisition unit is used to acquire the information to be restored, including:

The information acquisition unit is specifically configured to: receive the information to be restored, wherein the attribute information and operation information of the target element are acquired automatically and/or through human-computer interaction.

Optionally, the first operation unit is configured to, in response to querying the element identifier in the information to be restored, perform an operation indicated by the operation information of the first target element on the first target element in the webpage. , including: the first operation unit is specifically used for:

In the absence of a custom restoration rule, in response to querying the element identifier in the to-be-restored information, for the first target element in the webpage, perform the operation indicated by the operation information of the first target element. operate;

Optionally, the second operation unit is configured to, in response to querying the recursive path in the information to be restored, perform the operation indicated by the operation information of the second target element on the second target element in the webpage. , including: the second operation unit is specifically used for:

In the case where the custom restoration rule does not exist, in response to querying the recursive path in the information to be restored, for the second target element in the webpage, perform operation information on the second target element the indicated operation;

Optionally, the device further includes a fourth operation unit, and the fourth operation unit is used for:

In the presence of the custom restoration rule, the target element is operated according to the custom restoration rule.

The embodiment of the present application also provides a restoration device for webpage operation. Please refer to FIG. 6, which shows a schematic structural diagram of the restoration device for webpage operation. The device may include: at least one processor 601, at least one communication interface 602, at least one memory 603 and at least one communication bus 604;

In this embodiment of the present application, the number of the processor 601, the communication interface 602, the memory 603, and the communication bus 604 is at least one, and the processor 601, the communication interface 602, and the memory 603 communicate with each other through the communication bus 604;

The processor 601 may be a central processing unit (CPU), or a specific integrated circuit ASIC (Application Specific Integrated Circuit), or one or more integrated circuits configured to implement the embodiments of the present invention, etc.;

The memory 603 may include high-speed RAM memory, and may also include non-volatile memory (non-volatile memory), for example, at least one disk memory;

The memory stores a program, and the processor can execute the program stored in the memory to implement the method for restoring a webpage operation as described in the above item.

Embodiments of the present application further provide a readable storage medium, where the readable storage medium can store a computer program suitable for execution by a processor, and when the computer program is executed by the processor, implements the foregoing method for restoring a webpage operation.

Finally, it should also be noted that in this document, relational terms such as first and second are used only to distinguish one entity or operation from another, and do not necessarily require or imply these entities or that there is any such actual relationship or sequence between operations. Moreover, the terms "comprising", "comprising" or any other variation thereof are intended to encompass a non-exclusive inclusion such that a process, method, article or device that includes a list of elements includes not only those elements, but also includes not explicitly listed or other elements inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in a process, method, article or apparatus that includes the element.

The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same and similar parts between the various embodiments can be referred to each other.

The above description of the disclosed embodiments enables any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, this application is not intended to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (10)

1. a restoration method of web page operation, is characterized in that, comprises: Obtain information to be restored, the information to be restored includes attribute information and operation information of a target element, the target element is an element operated by a person in a web page, the attribute information is used to indicate the attribute of the target element, and the operation information Used to indicate the operation performed by the person on the target element, the attribute information includes at least one of an element identifier, a recursive path and a traversal path, where the recursive path is a path that starts from a leaf node and extends to a root node , the traversal path is a path extending from the root node to the leaf node; In response to querying the element identifier in the information to be restored, perform the operation indicated by the operation information of the first target element on the first target element in the webpage; the target element identified by the element; In response to querying the recursive path in the information to be restored, perform the operation indicated by the operation information of the second target element on the second target element in the webpage; the second target element is, the target element indicated by the leaf node in the recursive path. 2. The method of claim 1, further comprising: In response to not finding the element identifier and the recursive path in the information to be restored, perform the operation indicated by the operation information of the third target element on the third target element in the webpage; The three target elements are the target elements indicated by the last preset character string in the traversal path. 3. The method according to claim 1, wherein performing the operation indicated by the operation information comprises at least one of the following: The operation indicated by the operation information is performed by calling the encapsulation function of the mouse interface and/or the keyboard interface in the FIaUI library. 4. The method according to claim 1, wherein the obtaining the information to be restored comprises: The information to be restored is received, wherein the attribute information and operation information of the target element are acquired through automatic and/or human-computer interaction. 5 . The method according to claim 1 , wherein, in response to querying the element identifier in the information to be restored, the first target element in the webpage is subjected to the first target element. 6 . The operation indicated by the element's operation information, including: In the absence of a custom restoration rule, in response to querying the element identifier in the to-be-restored information, for the first target element in the webpage, perform the operation indicated by the operation information of the first target element. operate; The performing the operation indicated by the operation information of the second target element on the second target element in the webpage in response to the recursive path in the information to be restored is queried, including: In the case where the custom restoration rule does not exist, in response to querying the recursive path in the information to be restored, for the second target element in the webpage, perform operation information on the second target element the indicated operation; The method also includes: In the presence of the custom restoration rule, the target element is operated according to the custom restoration rule. 6. A restoration device for webpage operation, characterized in that, comprising: An information acquisition unit is used to acquire information to be restored, the information to be restored includes attribute information and operation information of a target element, the target element is an element operated by a person in a web page, and the attribute information is used to indicate the attribute information of the target element. attribute, the operation information is used to indicate the operation performed by the person on the target element, the attribute information includes at least one of an element identifier, a recursive path and a traversal path, and the recursive path starts from a leaf node, a path extending to the root node, where the traversal path is a path extending from the root node to the leaf node; a first operation unit, configured to perform the operation indicated by the operation information of the first target element on the first target element in the webpage in response to the element identifier in the information to be restored; the The first target element is the target element with the element identifier; a second operation unit, configured to perform the operation indicated by the operation information of the second target element on the second target element in the webpage in response to the recursive path in the information to be restored being queried; the The second target element is the target element indicated by the leaf node in the recursive path. 7. A restoration device for web page operation, comprising: a memory and a processor; the memory for storing programs; The processor is configured to execute the program to implement each step of the method for restoring a webpage operation according to any one of claims 1 to 5. 8. A readable storage medium on which a computer program is stored, wherein when the computer program is executed by a processor, the method for realizing the restoration method of the webpage operation according to any one of claims 1 to 5 is realized. each step. 9. A system for restoring web page operations, comprising: Designers, robots and management control platforms; The designer is used to obtain the information to be restored, and send the information to be restored to the management control platform; the information to be restored includes attribute information and operation information of a target element, and the target element is operated by a person on a webpage element, the attribute information is used to indicate the attribute of the target element, the operation information is used to indicate the operation performed by the person on the target element, and the attribute information includes an element identifier, a recursive path and a traversal path. At least one item, the recursive path is a path that starts from a leaf node and extends to a root node, and the traversal path is a path that starts from the root node and extends to the leaf node; The management control platform is used for sending the information to be restored to the robot; The robot is configured to, in response to querying the element identifier in the information to be restored, perform the operation indicated by the operation information of the first target element on the first target element in the webpage; A target element is the target element with the element identifier; In response to querying the recursive path in the information to be restored, perform the operation indicated by the operation information of the second target element on the second target element in the webpage; the second target element is, the target element indicated by the leaf node in the recursive path. 10. The system according to claim 9, wherein the management control platform is further used for at least one of the following: Sending a heartbeat message to the robot, the heartbeat message is used for the robot to maintain a heartbeat consistent with the management control platform; Monitor the status of the robot.

Images