Forum Moderators: open

Message Too Old, No Replies

Grub powers Wikia Search

         

incrediBILL

8:54 pm on Jan 7, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



The fact that Wikia bought Grub this year was a pretty good clue but now that they've launched Wikia it was easy to tie the crawl to the search results.

Wikia uses GRUB running out of swlabs.org to get their index:
149.20.54.195 “Grub/2.0 (Grub.org crawler; [grub.org...] ; bot@grub.org)”

Anyone spot them operating from anywhere else?

[edited by: jatar_k at 6:35 pm (utc) on Jan. 9, 2008]
[edit reason] fixed link [/edit]

wilderness

5:50 pm on Jan 9, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



all my grubs this month from the idenitcal IP.

thetrasher

12:05 pm on Jan 10, 2008 (gmt 0)

10+ Year Member



Identical IP.

149.20.54.195 - - [11/Dec/2007:**:**:** +0100] "GET /robots.txt HTTP/1.0" 200 **** "-" "Grub/2.0 (Grub.org crawler; http[i]:[/i]//www.grub.org[i]/[/i]; bot@grub.org)"

jmccormac

6:17 am on Jan 12, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Ditto here. All from the swlabs IP. I don't think that the Search Wikia people really appreciate the high regard in which Grub is held throughout the web. It is probably one of the most banned UAs after Nutch.

Regards...jmcc