Skip to content
Schema Generator
Menu

Crawlability

The ability of search engine crawlers to access and index your website content.

Examples

  • Internal linking
  • URL structure
  • Site architecture
Indexing
The process by which search engines add web pages to their database of searchable content.
Robots.txt
A text file that tells web crawlers which pages or files the crawler can or can't request from your site.
Sitemap
A file that provides information about the pages, videos, and other files on your site, and the relationships between them.