Forum Moderators: open
# FULL access (Alta Vista)
User-agent: Scooter
Disallow:
# FULL access (Excite)
User-agent: ArchitextSpider
Disallow:
# FULL access (Google)
User-agent: Googlebot
Disallow:
# FULL access (Inktomi)
User-agent: Slurp
Disallow:
# PARTIAL access (All Spiders)
# NO access (All Spiders)
User-agent: *
Disallow:
Is it possible that they are adding new exchange links but that google isn't seeing them as it is keeping the old crawl of the site on file. That would give them the benefit of the incoming links, but not the downside of the outgoing exchanged links.
Any thoughts?