Forum Moderators: open

Message Too Old, No Replies

GalaxyBot

I have never seen this before

         

quotations

7:58 pm on Jul 6, 2003 (gmt 0)

10+ Year Member



Galaxy.com sent a spider to one of my sites today.

I have never seen one before.

Most of the galaxy.com posts are from 2001 and 2002.

Is this something new?

GalaxyBot/1.0 (http://www.galaxy.com/galaxybot.html)

quotations

8:53 pm on Jul 6, 2003 (gmt 0)

10+ Year Member



A visit to their site says that it is brand new but there is no date on the page. Since they reference MSNBot then it must be fairly new.

GalaxyBot -- Galaxy's New Web Crawler
Look out GoogleBot! Look out MSNBot! Here comes GalaxyBot!

GalaxyBot is a new spider developed by the Internet's first directory provider Galaxy.com. In addition to providing highly relevant directory results, Galaxy.com will soon be offering full-text searches from across the web, searching billions of documents.

quotations

9:13 pm on Jul 6, 2003 (gmt 0)

10+ Year Member



Their directory looks just like dmoz.org from September 2002 to January 2003 but there appear to be some categories added which look exactly word for word like some Yahoo categories.

tschild

9:25 pm on Jul 6, 2003 (gmt 0)

10+ Year Member



What categories look like an outdated ODP? I couldn't find them on an admittedly cursory search.

The "directory" listings of galaxy.com look strange to me - as if they generated them automatically from the page a spider downloaded. For example, search for "Your browser cannot" ...

quotations

9:43 pm on Jul 6, 2003 (gmt 0)

10+ Year Member



examples sent by sticky.

Brett_Tabke

10:01 pm on Jul 6, 2003 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Galaxy is just about as old as Yahoo. It has been around since mid 95. The bot is the validation spider. Your site was submitted and the validation spider visited.

wilderness

10:40 pm on Jul 6, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



When I first began with my sites, I used a free submission service.
Galaxy was one of those included.

It was later of my opinion that the "free submission service" resulted in way too much spam.
UNRELATED to Galaxy.

I beieve Galaxy's theme previously was sort of a commercial business type.
Althought they visited my sites recently, not sure when I can recall the last previous visit.
Nor was I bombarded with referrals from the old Galaxy.

Don

quotations

3:26 pm on Jul 7, 2003 (gmt 0)

10+ Year Member



I got this today.

GalaxyBot was launched on July 1, although there was surely some nominal activity prior to 7/1.

Currently, the crawlers are in a discovery phase, building a taxonomy of known links on the web from pages that have already been included in the Galaxy Directory and Web Search (formerly First-Search). Most of the web requests you see are checking the validity of urls, but not actually downloading their content yet. That will come in the coming months. GalaxyBot has about 500 million links to verify before it will begin indexing content and adding new links.