Web Extractor

This bot can extract email, social media links and ANY other information from a list of URLs

MAIN FEATURES

Get Contact Data

It can extract contact details from a given URL such as email address, phone number, social media links, etc.

Extract ANY Data

Configure the app to extract any data you want from a URL; it lets you set a Regex or Xpath and extracts the data that matches with the given Regex or Xpath from the page.

Easy to use

Simply enter a list of URLs to scrape data from, and the app will do the rest of the work. To configure the app to extract more data just set the Regex or Xpath; don’t worry if you’re not familiar with this, we’ll help you set it up.

Support

If you have any questions or need any kind of help, just contact us and someone from our support team will get in touch with you.

Try it before you buy

Free Version

With the free version you can extract data from 10 domains at a time.

Download Free Version

Full Version

Full version has no limits.

Buy Full Version for $50

Instructions

  • The free version will process only 10 websites at one time.
  • Full version has no limit and you can input as many websites as you want.
  • By default, the app will extract 3 pages if email data is not found on the first page; the other 2 pages are usually the ‘Contact’ and ‘About’ pages.
  • You can change the number of pages to extract by navigating to: Options > Page Limit > Set the Pages, then click ‘Update;’ you should set the pages to 1 if you only want to visit the first page.
  • Other than email address, all other data is extracted from the home page only.
  • The app can be customized to extract any data on a given URL. To add a new data field, follow these steps below:
    1. Click on Options > Customize > on customize form click 'Add new item'
    2. This form shows 3 input fields.
      • a: ‘Name’ - give this field a name which will be shown in the output grid and Excel file.
      • b: ‘Type’ - there are 2 options to select here:
        XPath: A query language for selecting nodes from an HTML page; for example, to get the title tag of a page and Xpath will be //title, then for meta description the Xpath will be //meta[@name=' description ']. Please refer to: https://www.w3schools.com/xml/xpath_syntax.asp to better understand Xpath.
        Regex: A string of text that allows you to create patterns to help match, locate, and manage text on a page's HTML. Please refer to http://www.rexegg.com/regex-quickstart.html to learn more about it.
      • 3: Xpath / Regex : Value of the xpath or regex should be entered in this text box.
    3. Click Save to add this field.
    4. You can add / delete as many fields as you want.
  • Speed of the application is based on internet speed.

Frequently asked questions

Download Botsol Web Extractor

Go To Download Page