Forum Moderators: open

Message Too Old, No Replies

Accidental disallow in robots.txt!

         

lavapies

10:27 am on Aug 12, 2002 (gmt 0)

10+ Year Member



Hi folks,

I accidentally (OK it was very stupid) disallowed crawling in my robots.txt file and Google hasn't visited in a while (and Inktomi have temporarily dropped us)

Will they come back?

Thanks :-)

gsx

11:43 am on Aug 12, 2002 (gmt 0)

10+ Year Member



Unlikely, this month. If you asked it not to spider, it didn't. It is a harsh reality; you will not be spidered until next month, and not listed until the month after that.

Inktomi paid pages will be read every couple of days, so that shouldn't take long. Free pages listed there may takes months to get back (if at all).

lavapies

11:59 am on Aug 12, 2002 (gmt 0)

10+ Year Member



Thanks gsx,

That's what i feared with google. A relief about Inktomi though :-)

Thanks again for the lowdown. I'll have to start being more careful!