Page is a not externally linkable
- Advertising
-- Paid Inclusion Engines and Topics
---- Slurp/si bot hitting only robots.txt every day, dropped from index.

GreenLeaf - 10:04 am on Jan 15, 2004 (gmt 0)


Thank you, Sid, for your advice.
I checked my robots.txt - no errors detected.
It's simple:

User-agent: *
Disallow: /admin/
Disallow: /webstat/
Disallow: /test/

My .htaccess is unchanged since site's beginning.
I still can't understand the situation.
?

Thread source:: http://www.webmasterworld.com/paid_inclusion/2429.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com