Documentation

Crawl Settings

There are three different ways you can enter the URLs associated with the domain you would like to scan:

  1. Add a link to your sitemap
  2. Enter the URLs manually
  3. Let our tool automatically index all URLs associated with your site

crawling method

If you have opted to auto-index a domain, our software will first collect all of the URLs associated with that domain. Once complete, you will have the option to select which URLs you want to include in the scan.

If you have entered the URLs manually or uploaded a sitemap, the software will automatically start scanning all of the URLs.