Forum Moderators: open

Message Too Old, No Replies

Robozilla out for a cruise

ODP linking checking

         

Brett_Tabke

8:13 am on Apr 5, 2002 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Robozilla, the ODP's link check bot is out in full force checking links. It might be a good idea to keep and eye on your favorite odp listing - stuff happens.

EliteWeb

8:49 am on Apr 5, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



(: I love that little bugger.

skibum

2:50 pm on Apr 5, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



It always flags a bunch, especially these days with free homepage providers pulling back and lower bandwidth caps imposed. Anyone know how many sites, on average, get flagged on a typical Robo run?

vmcknight

6:38 pm on Apr 5, 2002 (gmt 0)

10+ Year Member



It's about 50,000 this time (out of three and a quarter million links).

A lot will be temporary server not found errors - if they're back up when an editor checks them, they won't get pulled.

EliteWeb

6:41 pm on Apr 5, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I pulled a few - not couz they were hosting related but the websites didnt want to have those pages anymore or support the products anymore. oh well ;)

MarkHutch

7:02 pm on Apr 5, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Yes, indeed. Saw the little guy about two weeks ago on one of our sites. Seems to hit about the same time every month. That site is new to ODP. Does the URL checker hit about once per month??

Quadrille

8:56 pm on Apr 5, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



On average about once a month - but not a terribly regular thing. Always welcome, though - feels cleaner after the dead leaves have been swept away!