Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

The scraping assistant tool is bundled by default in the WSO2 Application Server and WSO2 Mashup Server products. If it is not included in your product distribution, you can add it by installing the above feature using the instructions given in section Feature Management.  

Follow the instructions below to invoke the tool.

1. Log on to the product's Management Console and select "Scraping Assistant" in the "Tools" menu.

Image RemovedImage Added

2. The "Scraping Assistant" window opens with an empty config tag.

Image RemovedImage Added

3. The tool's menus can be used to write the XML configuration according to your requirements. For example,

3.1 select the "Add HTTP request" menu item.

Image RemovedImage Added

It inserts a line to retrieve a page available at a given URL as follows:

...

3.4 Optionally, use a variable name that has some semantic value, to get a completed configuration as shown in the example below.

Image RemovedImage Added

3.5 This example scraper configuration can be used in script as shown in the example below:

...