| Welcome to WebmasterWorld Guest from 18.104.22.168 |
register, login, search, subscribe, help, library, PubCon, announcements, recent posts, open posts,
|Accredited PayPal World Seller|
| 2:39 pm on Apr 15, 2003 (gmt 0)|
im getting lots of visits from the inktomi bot.
it keeps requesting for the robots.txt
what should i add in the robots file to make inktomi index my pages?
| 2:58 pm on Apr 15, 2003 (gmt 0)|
You don't need to add anything (or even have a robot.txt). Just make sure that if you do have a robot.txt it's written properly and not blocking spiders.
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld ® and PubCon ® are a Registered Trademarks of Pubcon Inc.
© Pubcon Inc. 1996-2012 all rights reserved