

Word Count – Analyze the number of words per page.Crawl Depth – See how deep a URL is in a website’s structure.Last-Modified Header – View the HTTP header’s last modified date.Response time – See how long it takes pages to respond to your requests.Meta Keywords – These keywords are used primarily for regional or reference search engines, not by Google, Bing, or Yahoo.Meta Description – Missing, duplicate, long, short, or multiple descriptions.Page Titles – Missing, duplicated, long, or multiple title elements.Duplicate pages – Use advanced algorithmic checks to find exact duplicates and close copies of pages.Security – Find insecure pages, insecure forms, and missing security headers.External Links – View all links, including their status codes and source page.Blocked Resource – View and audit the blocked resources in rendering mode.Block URLs – View and audit URLs that are blocked by robots.txt.Redirects – Permanent, Temporary, JavaScript redirects, and meta refreshes.Errors – Client errors such as broken links & server errors (No responses, 4XX client & 5XX server errors).Here is a quick overview of some data that are collected during a crawl: The Screaming Frog SEO Spider is an auditing tool created by real SEO experts with thousands of worldwide users.

Advanced URL Mapping allows you to compare staging and production environments. You can track the progress of SEO opportunities and issues and what has changed between crawls. You can also automate the entire process via the command line. You can schedule crawls to run at specific intervals or export crawl data to any location, including Google Sheets. Interactive crawl, directory force-directed diagrams, and tree graph site visualizations can be used to assess internal linking and URL structure. This allows you to crawl dynamic, JavaScript-rich websites and frameworks like React, Angular, and Vue.js. To render web pages, you can use the integrated Chromium WRS. To fetch performance and user data for all URLs crawled in a crawl. Integrate With GA, GSC & PSIįor more insight, you can connect to Google Analytics, Search Console, and PageSpeed Insights APIs. You can quickly create XML Sitemaps and Image XML Sitemaps with advanced configuration URLs, which include last modified, priority, and change frequency. You can view URLs that are blocked in robots.txt, meta robotics, or X-Robots -Tag directives like ‘noindex’ or ‘nofollow’ and canonicals, as well as, rel=”next”, and rel=”prev.” Generate XML Sitemaps This could include social meta tags, additional headings, and prices. Extract Data With XPathĪny data you find in the HTML of a webpage can be collected using CSS Path, XPath, or regex. You can also search for partially duplicated elements, such as page titles and descriptions, including low content pages. Use the md5 algorithmic scan to find exact duplicate URLs. You can analyze both page titles and meta descriptions during a crawl to identify duplicates or pages that are too long, too short, missing, not present, or duplicated throughout your site.

Upload a list to be audited in site migrations. Locate temporary and permanent redirects.

Bulk exports the errors and URLs to either fix or send to a developer. Instantly crawl a website and identify broken links (404s) and server errors. It provides key onsite data to help SEOs make informed decisions. SEO Spider is a flexible and powerful site crawler that can crawl small and large websites quickly and allows you to analyze the results in real-time. What Can You Do With The SEO Spider Tool?
Screaming frog seo spider tool license#
You can download and crawl 500 URLs free of charge, or you can purchase a license to unlock advanced features. The Screaming Frog SEO Spider helps you improve your on-site SEO by extracting data and auditing common issues. This system made them swear off SEO for good, because it uses some of the same skills but in a much more powerful and profitable way! SEO Spider Tool And at the end, I’ll answer some of the most often asked questions regarding Screaming Frog SEO Spider and website crawling tool in general.īut most importantly, you’ll see the exact step-bey-step system that many others have used to grow their own successful online business to more than $40,000 a month in passive income.
