Page is a not externally linkable
- Advertising
-- Paid Inclusion Engines and Topics
---- Pages dropped after spider visit?


engine - 4:44 pm on Jul 7, 2000 (gmt 0)


JamesR, welcome.
It'll be interesting to see if the simple, duplication technique I'm using gets the pages/site booted out of AV et al. It's AV I'm targeting to measure the "sensitivity."
It's a pretty crude technique but the result will show how close to the line to go, or not go as the case may be.
I actually want the pages out without deleting them from the site.

I'll report back when the test is complete, but, I expect to have to wait until the index is updated.

Coming back to the question, did anyone notice which spider is the culprit?


Thread source:: http://www.webmasterworld.com/paid_inclusion/58.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com