Site Analysis slows after 1000 pages. Problems???

Use and application of eValid's site analysis (site scanning) features.

Site Analysis slows after 1000 pages. Problems???

Postby DavidC » Mon Dec 16, 2013 11:30 am

Morning all.

That site analysis engine is just great, but after 1000 pages it
gets very slow.

Am I doing something wrong?
DavidC
 
Posts: 1
Joined: Mon Dec 16, 2013 11:24 am

Re: Site Analysis slows after 1000 pages. Problems???

Postby eValid » Tue Dec 17, 2013 11:12 am

DavidC wrote:Morning all.

That site analysis engine is just great, but after 1000 pages it
gets very slow.

Am I doing something wrong?


Hey DavidC and welcome to the eValid forum.

No eValid is working fine.

It's a computer program, after all.

After 1,000 pages we, too, find that the size of the evalid
executable footprint grows and grows. The cache grows...it is
storing all 1,000 pages so it doesn't have to reload them.

And, the internal tables that keep track of the dependencies
that the site analysis discovers between all the pages
it has spidered also grows. If the website being scanned uses
very long URLs...then the size of that table grows even faster.

No, you're not doing anything wrong. But in practical terms
we do recommend that site analysis runs be targed to websites
(sometimes we call them sub-websites) that have 1,000 pages
or fewer.

Thanks for posting.

-eValid Support
eValid
 
Posts: 1731
Joined: Tue Jan 01, 2008 12:48 pm
Location: USA


Return to Website Scanning and Analysis

Design Downloaded from free phpBB templates | free website templates | Free Web Buttons