homepage Welcome to WebmasterWorld Guest from 54.145.141.127
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconHow to deal with a robots.txt hack attack
  Guidelines to mitigate the damage from an attack
3Whitey 10:17 pm on Oct 17, 2006 (gmt 0)
newpost thread iconMainseek bot
  this bot is ripping through our site
2ssgumby 6:36 pm on Oct 14, 2006 (gmt 0)
newpost thread iconGoogle indexing weird links
  ones with // in them
4netchicken1 12:54 am on Oct 13, 2006 (gmt 0)
newpost thread iconPlease welcome your new moderator: goodroi
 
20engine 6:35 am on Oct 11, 2006 (gmt 0)
newpost thread iconrobots.txt problem and subdirs / wildcards
 
2disgust 1:44 pm on Oct 10, 2006 (gmt 0)
newpost thread iconGoogle Sitemaps Robots.txt Question
 
2Tonerman 5:31 pm on Oct 9, 2006 (gmt 0)
newpost thread iconNaming da' bots
  Same place, different face
1Reno 11:58 am on Oct 7, 2006 (gmt 0)
newpost thread iconTravelLazerBot
  Anyone seen this bot before?
2jexx 7:44 pm on Oct 3, 2006 (gmt 0)
newpost thread iconDisallow Coldfusion Pages Only
  Stop cfm pages from being crawled
2stcrim 3:18 pm on Oct 3, 2006 (gmt 0)
newpost thread iconRemoving specific file type
 
8MisterT 11:40 pm on Sep 28, 2006 (gmt 0)
newpost thread iconRobots - Allowing them
  rather than disallow
2SanDiegoPaul 10:30 pm on Sep 28, 2006 (gmt 0)
newpost thread iconRobots.txt & meta
  Robots meta tage or just a robots.txt
4pazang 7:45 pm on Sep 27, 2006 (gmt 0)
newpost thread iconDo excluded pages still count as links-in
 
3johnlod 8:14 pm on Sep 26, 2006 (gmt 0)
newpost thread iconOrder of lines in robots.txt file
  Can you control a bot with the order of the lines?
3bouncybunny 3:37 am on Sep 23, 2006 (gmt 0)
newpost thread iconrobots & blog
 
2zuses 2:54 pm on Sep 22, 2006 (gmt 0)
newpost thread iconKeeping robots out of cgi bin
  What's the best format?
10Reno 6:00 pm on Sep 21, 2006 (gmt 0)
newpost thread iconWhat user agent does Overture use?
  when they ping your page for quality
2Bewenched 8:35 pm on Sep 20, 2006 (gmt 0)
newpost thread iconRobots.txt help
 
2Northstar 7:50 pm on Sep 20, 2006 (gmt 0)
newpost thread iconNeed Help With Robots.txt Question
 
4BlueLeaf 4:23 am on Sep 19, 2006 (gmt 0)
newpost thread iconContrary advice over robots.txt validity
  Who is right Google or the other?
3netchicken1 1:05 pm on Sep 18, 2006 (gmt 0)
newpost thread iconDisallow page disallows variables, too?
  example.php and example.php?id=10
34string 8:50 pm on Sep 17, 2006 (gmt 0)
newpost thread iconindex, all?
 
3Boogalou 4:07 am on Sep 17, 2006 (gmt 0)
newpost thread iconDisallowing access to feed URLs
  Should I disallow access to feed and trackback URLs
1kektex 4:45 am on Sep 16, 2006 (gmt 0)
newpost thread iconExclude all robots on alias domains?
  Good idea or not?
1jtara 5:52 pm on Sep 15, 2006 (gmt 0)
newpost thread iconStrange way of writing robots.txt
  Has anybody use this?
2Cyclob 3:04 pm on Sep 15, 2006 (gmt 0)
Displaying Page 34 of 72<< Back 1 ... 24 25 26 27 28 29 30 31 32 33 [ 34 ] 35 36 37 38 39 40 41 42 43 ... 72 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved