41
Getting Started: Scanning Your Website
Getting Started: Scanning Your Website
41
4.4
Step 3: Specify Crawler Options
Screenshot 37 – Scan Wizard Crawling Options
1. In this dialog you can configure the crawling options.
Crawling Options
The Crawler traverses the entire website and identifies its structure.
The
following crawling options may be configured:
Start HTTP
Sniffer
for manual crawling at the end of the scan
process – this option will start the HTTP Sniffer automatically at the end
of the crawl process, enabling you to browse (the browser must be set to
use Acunetix WVS as proxy) parts of the site that the crawler could not
reach or did not find. Frequently these are pages are linked via
JavaScript menus or other methods. Although the Acunetix WVS handles
JavaScript, there may be situations where a manual crawl is still required.
The crawler will update the site structure with the newly discovered links
and pages.
Get first URL only – Scan only the index or first page.
Do not fetch anything above start folder - Select this option to instruct
the crawler not to follow any links above the start folder. For example, if
you specify http://testphp.acunetix.com/wvs/ as a start URL it will not
traverse the links which point to a location above the base link e.g.
http://testphp.acunetix.com/. However it will traverse all links to pages
located in the /wvs/ folder or any of its subfolders.
Fetch files below base folder
-
Select this option to also follow links
which are contained outside the base folder. For example, if you specify
http://testphp.acunetix.com/ as a start URL it will traverse the links which
point to a location below the base link e.g.:
Fetch directory indexes even if not linked
-
Select this option to
instruct the crawler
to request the directory index for every discovered
directory even if the directory index is not directly linked.
 |
 |
 |