UseSitemap

Name

UseSitemap -- defines whether to use Sitemap Protocol when crawling

indexer.conf

Synopsis

UseSitemap {yes | no}

Description

UseSitemap defines whether to use Sitemap Protocol to fetch the list of URLs available for crawling on a website.

Sitemaps are particularly useful for websites where some areas are not available through the browsable interface.

The default value is yes

Note: As Sitemap Protocol is a supplement to Robots Exclusion protocol, indexer can not use Sitemap Protocol if Robots is set to no.

Examples


UseSitemap yes
      

See also

UseCookie, URL, Robots.