57
Site Crawler Tool
Site Crawler Tool
57
5. Site Crawler Tool
5.1
Introduction
The Site Crawler
tool traverses the target site and builds
an internal
representation of the site
layout
using
the information
(e.g. web pages and
directories) collected. You can configure what the crawler
fetches by
selecting Configuration > Settings in the Tools Explorer and Tool Settings
> Crawler from the Settings Interface.
The site crawler tool is automatically launched by the web scanner. You can
use the site crawler tool to analyze
the structure of a website without
automatically launching the attacks.
Screenshot 53 – The crawler tool interface
The Crawler tool interface consists of:
Toolbar – Here you can specify the URL and start a crawl.
Site structure window (left hand side) – Displays target site information
fetched by the crawler, e.g., cookies, robots, and files.
Details window (right hand side) – Displays general information about a
file selected in the site structure window (e.g., filename, file path). At the
bottom of the details window, there is a tabbed tool bar. Clicking on the
Referrers, Headers, Inputs, View Page or HTML analysis tabs will show
further information about the object selected.
 |
 |
 |