Cross-domain DOM Pickup and Automation Scheme of RPA System Based on Browser Extension

Abstract

Robotic process automation(RPA) is one of today's research hotspots.The pickup and automation of web page elements is one of the important functions of RPA.RPA injects scripts into the web page to process web pages by using browser extensions,using web page element positioning path to locate to the target node for automated operations.When there is a cross-domain frame in the source web page,due to the limitations of the same-origin strategy,the script injected into the source web page can not obtain the DOM object of the target node,resulting in the inability to generate a web page element positioning path,so that it can not be automated.When processing a web page containing a third-party cross-domain frame,the scheme treats it as a frame process equal to the status of the source web page frame,and the web page element positioning path is designed to contain the url of the frame and the form of the web page element Xpath to achieve cross-domain web page element pickup and automation.Experiments show that the scheme can effectively pick up and automate the elements of cross-domain web pages,and support chrome,firefox,and other browsers that support browser extensions.

Keywords

• browser extensions|cross-domain|rpa