Why does a large scan -- about 2400 pages -- take so long?

Use and application of eValid's site analysis (site scanning) features.

Why does a large scan -- about 2400 pages -- take so long?

Postby solu » Thu Sep 02, 2010 3:44 pm

Why does a large scan -- about 2400 pages -- take so long?
solu
 
Posts: 2
Joined: Fri Jan 29, 2010 10:27 am

Re: Why does a large scan -- about 2400 pages -- take so long?

Postby eValid » Tue Sep 07, 2010 11:19 am

solu wrote:Why does a large scan -- about 2400 pages -- take so long?

A large site analysis scan takes a long time if the pages are large and/or if they are slow to download.

As you know, an eValid site analysis run involves actually downloading every page in the scan. This is done so that the analysis that eValid does is 100% accurate and based totally on what is send "over the wire" to the local browser.

All that accuracy and measurement confidence only happens with full downloads, and that's why a 2,400 page scan may take some time.

Just FYI, in practical terms, the eValid site analysis engine can be set to run with 10,000 or 100,000 or 1,000,000 pages as the upper limit -- and it will run just fine until it runs out of memory to store the hash-coded internal lookup table that stores the list of URLs already visited and about to be visited. We generally limit our scans to under 10,000 pages for this reason.

The eValid Team
eValid
 
Posts: 2392
Joined: Tue Jan 01, 2008 12:48 pm
Location: USA


Return to Website Scanning and Analysis

Design Downloaded from free phpBB templates | free website templates | Free Web Buttons