homepage Welcome to WebmasterWorld Guest from 54.166.53.169
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
TripAdvisorBot
Anyone seen this?
bobbarnes

5+ Year Member



 
Msg#: 3255380 posted 12:50 pm on Feb 17, 2007 (gmt 0)

I have a travel guide website and have just noticed this make its first appearance.

I seem to remember reading somewhere that a TripAdvisor bot crawls
the web for content which is then re-written by their editors. Don't know if this is accurate ..?

 

malachite

5+ Year Member



 
Msg#: 3255380 posted 8:31 pm on Feb 26, 2007 (gmt 0)

This bot has visited one of my sites a few times over the last month, asking for robots.txt and one other page.

As it's highly unlikely to bring any traffic to the site, I've now banned it.

londrum

WebmasterWorld Senior Member 5+ Year Member



 
Msg#: 3255380 posted 10:28 pm on Mar 16, 2007 (gmt 0)

i don't suppose you know the name of it? i wouldn't mind banning it too

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved