Looksmart Limited (LKST)

[Smuggler]

New Servers in Service
Posted: May 29, 2003
Section: Site News
Placement: Front Page
Posted By: Kord Campbell
--------------------------------------------------------------------------------
An additional 16 servers were placed into service over the weekend.

Adding these new boxes brings the total number of servers running in the Grub cluster up to a total of 25 boxes. This pool of servers handle the connections to the clients as they connect, and each contain a separate database of URLs which we are crawling.

Putting the servers into service requires moving the URL databases around a bit, and also causes a brief drop in the numbers of URLs that we are crawling.

With these improvements to the system we now have the capacity to handle 10s of thousands of clients. With those types of client numbers we will have the ability to crawl and index *billions* of URLs each day.