Tag:scalability

eBay vanishes: old routers stymied by explosive growth in web
eBay vanishes: old routers stymied by explosive growth in web

This week, arbitrary amounts of web traffic slowed or failed outright – including eBay in the UK – due to a long-known limitation on the number of addresses supported by older routers. Within these traffic-handling devices, a phone-book-like lookup technique known as the Border Gateway Protocol matches web page address requests to IP addresses: older routers…

Read more

Large-scale IDOL index management

How many records can I expect one IDOL content engine to handle? The magic number is ten million ‘documents’ per content engine. This is not the simple number of ‘documents’ created: the number is incremented for each version, individual items inside ZIP or compressed folders, and each attachment on contributed email. Beware: some re-indexing techniques also…

Read more