homepage Welcome to WebmasterWorld Guest from 204.236.254.124
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Directories
Forum Library, Charter, Moderators: Webwork & skibum

Directories Forum

    
Robozilla/1.0
proxyHunter




msg:471347
 2:06 am on Nov 3, 2003 (gmt 0)

when robozilla hits your site, is it because you have submitted to be added to the directory and its finally come around to check your site, or if you already have a site in the directory does it check your site is functioning?

 

operafan




msg:471348
 2:44 am on Nov 3, 2003 (gmt 0)

I believe it's when after your site is listed & it comes out on a monthly basis to check all links to see which are working & which aren't.
So when he comes your site better be working :)

korkus2000




msg:471349
 2:47 am on Nov 3, 2003 (gmt 0)

It also checks sites in the queue. You may be visited by robozilla without an actual listing. Like said above it is just checking for 404s and does not include your site. DMOZ inclusion is completely done by human hands.

windharp




msg:471350
 5:29 am on Nov 3, 2003 (gmt 0)

> It also checks sites in the queue.

Well, that is an idea for a nice bonus feature. Until now, it only checks listed sites.

FYI - Some additional information about RoboZilla can be found at [en.wikipedia.org...]

joeblakesley




msg:471351
 9:47 am on Nov 3, 2003 (gmt 0)

He even has his own profile :)

[dmoz.org...]

(OK...I was bored...had to mention that...I'll go now.)

Joe

P.S. More serious info here:
[inelegant.org...]
[dmoz.org...]
[dmoz.org...]
[dmoz.org...]

totalXSive




msg:471352
 8:12 pm on Nov 7, 2003 (gmt 0)

As windharp says, Robozilla only visits listed sites (so a hit from Robozilla could be seen as a positive signed that you're listed). He may visit sites that are waiting for review in future but at present he does not.

Another ODP-related bot to look out for is 'TulipChain', a Java application run by individual editors for checking listings. This can optionally check submitted sites too.

korkus2000




msg:471353
 8:16 pm on Nov 7, 2003 (gmt 0)

>>He may visit sites that are waiting for review in future but at present he does not.

He has in the past. Must have taken that feature away. There was confirmation from metas and webmasters who were not listed but did spot robozilla, including me.

kctipton




msg:471354
 2:58 am on Nov 8, 2003 (gmt 0)

I've edited a really long time (about 4 years) and robozilla has NEVER visited unlisted sites in that time. They have to be listed to be visited.

korkus2000




msg:471355
 3:32 am on Nov 8, 2003 (gmt 0)

Here is a moldy oldy

[webmasterworld.com...]

After that thread I did some research and found a lot more webmasters getting robozilla while not being listed.

totalXSive




msg:471356
 7:28 pm on Nov 8, 2003 (gmt 0)

Very odd. All I can guess is that it was perhaps a test feature. Either way, at the moment, Robozilla only visits listed sites - if he did visit unlisted ones then he doesn't anymore.

kctipton




msg:471357
 2:46 am on Nov 9, 2003 (gmt 0)

I guess I should clarify that I don't know that Robozilla ever marked any sites as nonworking if they were sitting in unreviewed. Visit maybe, but mark broken, no.

theseeker




msg:471358
 8:14 am on Nov 9, 2003 (gmt 0)

I don't think Robozilla checks sites in unreviewed, but I suppose there might be some test going on I don't know about. One thing to think about though, I could create my own linkchecker and have it send Robozilla/1.0 as the user agent. Other than through the IP address, there's no way to know if it is the ODP's Robozilla.

tschild




msg:471359
 4:45 pm on Nov 9, 2003 (gmt 0)

A robozilla visit to an URL could also be the result of

- your site being listed in some editor's bookmarks (the ODP search function does not cover the bookmarks)

- your site being listed in a category you don't expect it to be listed in.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Directories
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved