CrawlerThreads defines the number of crawling threads to start by default, when the -N command line option is not given to indexer.
More threads usually give better crawling speed (especially when working with remote sites), but consumes more CPU time and loads the database higher.
The default value is 1.
CrawlerThreads takes global effect for the entire configuration file and should be used only one time.