Spidering freeware downloads, downloadable, downloading

SiteMap For Google

... approach in orders of magnitude quicker than actually spidering the site yourself with a tool like Xenu ... sitemap in a couple of seconds. To speed spidering, and ensure the most important files get spidered ...