Large-scale IDOL index management

Large-scale IDOL index management

How many records can I expect one IDOL content engine to handle? The magic number is ten million ‘documents’ per content engine. This is not the simple number of ‘documents’ created: the number is incremented for

  • each version,
  • individual items inside ZIP or compressed folders,
  • and each attachment on contributed email.

Beware: some re-indexing techniques also cause outright duplication instead of replacing these records. Chris RuBert posted instructions on checking the accumulation within your IDOL content engine(s).

If you do need to repartition your content, here is some commentary from one firm’s project to configure 47,000,000 records across multiple content engines.

Leave a Reply

Your email address will not be published. Required fields are marked *