Download for free, or purchase a licence for additional advanced features.Ĭrawl a website instantly and find broken links (404s) and server errors. The Screaming Frog SEO Spider is a website crawler, that allows you to crawl websites’ URLs and fetch key onsite elements to analyse onsite SEO. However, to be able to crawl millions of URLs, an SSD and 16gb of RAM (or higher) is our recommended hardware. It is able to save crawl data in RAM, or to disk in a database.įor crawls under 100-200k URLs a 64-bit OS and 8gb of RAM should be sufficient. The SEO Spider is capable of crawling millions of URLs with the correct hardware, memory and storage. The minimum specification is a machine with at least 1gb of RAM.
0 Comments
Leave a Reply. |