The Sitemaps.org Protocol v0.9 Architecture
Jointly introduced by Google, Microsoft, and Yahoo, the Sitemaps.org protocol establishes a uniform XML schema allowing webmasters to explicitly declare which pages are available for crawling.
Without a sitemap, search engine web crawlers must discover pages by traversing hyperlinks from the homepage. On complex single-page applications (SPAs) or deep architectural hierarchies, isolated "orphan" pages may never be discovered. An authoritative XML sitemap guarantees 100% crawl discovery.
Sitemaps.org XML Schema Tag Reference & Guidelines
| XML Tag | Specification Format | Description & Crawler Usage | Requirement |
|---|---|---|---|
| <loc> | https://example.com/page | Absolute canonical URL of the page | Mandatory |
| <lastmod> | YYYY-MM-DD (W3C Datetime) | Date of most recent content update | Strongly Recommended |
| <changefreq> | daily, weekly, monthly... | Estimated update frequency hint | Optional |
| <priority> | 0.0 to 1.0 | Relative importance within this domain | Optional |
Sitemap Index Architecture for Large Sites
When a website exceeds 50,000 URLs, use a master sitemap-index.xml that links to sub-sitemaps: e.g. /sitemap-articles.xml, /sitemap-products.xml, and /sitemap-categories.xml. This modular setup allows Google Search Console to display indexing ratios per content section.
Accurate lastmod Maintenance
Never mass-update the <lastmod> tag to the current date if the content has not changed. Search engines penalize false lastmod updates by ignoring the tag entirely for your domain. Only update lastmod when substantive text or code changes occur.