Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

Blocking Windows Live robot/spider.

9:14 pm on Sep 5, 2007 (gmt 0)

Junior Member

10+ Year Member

joined:Dec 13, 2004
votes: 0

I would rather lose all windows live traffic rather than explain why sites I host get a simmulated or live MS sex traffic search visitor for a '***** enlargement' and so on.

I guess its the robots file I need to change but what is the spider - can anyone help?

I have had MS live's search engine visits for other unrelated searches on cars and drugs from MS live before but I draw the line here and wish to block them all now.

10:56 am on Sept 7, 2007 (gmt 0)

Senior Member

joined:Jan 27, 2003
votes: 0

Hi Tidal2,

It's probably worth looking at the thread strange referrer activity [webmasterworld.com] which includes a reply from an MSN rep.

Unfortunately, the spider resulting in the adult terms you see is not the Live search engine spider (indeed, it does not identify itself as a spider at all). Your only solution if you genuinely don't care about MSN referrals is to block the IP addresses used by this 'test'.

The suggestion in the thread I mentioned is that blocking this activity could result in you dropping out of live results entirely, but you probably have a better chance of staying in the results and still blocking the unwanted activity by banning the IPs, which I imagine would be the best of both worlds.


Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members