mnoGoSearch 3.4.1 reference manual: Full-featured search engine software
PrevNext

CrawlDelay

Name

CrawlDelay -- defines the number of seconds to wait between requests to the same server

indexer.conf

Synopsis

CrawlDelay {seconds}

Description

CrawlDelay defines to the number of seconds to wait between successive requests to the same server, for polite crawling.

The default value is 0.

Scope

CrawlDelay affects all Server and Realm commands until the end of the configuration file, or until the next CrawlDelay command.

Examples


CrawlDelay 10

See also

the Section called Running multiple indexer instances for crawling in Chapter 3, CrawlerThreads, IPRequestPerMinLimit, URLSelectSkipLock.

PrevHomeNext
ComplexSynonymsUpCrawlerThreads