Forum Moderators: open
GalaxyBot -- Galaxy's New Web Crawler
Look out GoogleBot! Look out MSNBot! Here comes GalaxyBot!
GalaxyBot is a new spider developed by the Internet's first directory provider Galaxy.com. In addition to providing highly relevant directory results, Galaxy.com will soon be offering full-text searches from across the web, searching billions of documents.
It was later of my opinion that the "free submission service" resulted in way too much spam.
UNRELATED to Galaxy.
I beieve Galaxy's theme previously was sort of a commercial business type.
Althought they visited my sites recently, not sure when I can recall the last previous visit.
Nor was I bombarded with referrals from the old Galaxy.
Don
GalaxyBot was launched on July 1, although there was surely some nominal activity prior to 7/1.
Currently, the crawlers are in a discovery phase, building a taxonomy of known links on the web from pages that have already been included in the Galaxy Directory and Web Search (formerly First-Search). Most of the web requests you see are checking the validity of urls, but not actually downloading their content yet. That will come in the coming months. GalaxyBot has about 500 million links to verify before it will begin indexing content and adding new links.