I have robots.txt file... Still Gbot only crawls index, and 1 link? - (deprecated) Google News Archive forum at WebmasterWorld - WebmasterWorld

Forum Moderators: open

Message Too Old, No Replies

I have robots.txt file... Still Gbot only crawls index, and 1 link?

derekwit

7:08 pm on Dec 13, 2002 (gmt 0)

10+ Year Member

Gbot visits me at least once a day. He still only crawls my index file and suggestions.

derekwit

7:15 pm on Dec 13, 2002 (gmt 0)

10+ Year Member

Sorry....Any suggestions?