Why does a large scan -- about 2400 pages -- take so long?
Posted: Thu Sep 02, 2010 3:44 pmWhy does a large scan -- about 2400 pages -- take so long?
solu wrote:Why does a large scan -- about 2400 pages -- take so long?
A large site analysis scan takes a long time if the pages are large and/or if they are slow to download.
As you know, an eValid site analysis run involves actually downloading every page in the scan. This is done so that the analysis that eValid does is 100% accurate and based totally on what is send "over the wire" to the local browser.
All that accuracy and measurement confidence only happens with full downloads, and that's why a 2,400 page scan may take some time.
Just FYI, in practical terms, the eValid site analysis engine can be set to run with 10,000 or 100,000 or 1,000,000 pages as the upper limit -- and it will run just fine until it runs out of memory to store the hash-coded internal lookup table that stores the list of URLs already visited and about to be visited. We generally limit our scans to under 10,000 pages for this reason.
The eValid Team