homepage Welcome to WebmasterWorld Guest from 54.166.108.167
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconNaming da' bots
  Same place, different face
1Reno 11:58 am on Oct 7, 2006 (gmt 0)
newpost thread iconTravelLazerBot
  Anyone seen this bot before?
2jexx 7:44 pm on Oct 3, 2006 (gmt 0)
newpost thread iconDisallow Coldfusion Pages Only
  Stop cfm pages from being crawled
2stcrim 3:18 pm on Oct 3, 2006 (gmt 0)
newpost thread iconRemoving specific file type
 
8MisterT 11:40 pm on Sep 28, 2006 (gmt 0)
newpost thread iconRobots - Allowing them
  rather than disallow
2SanDiegoPaul 10:30 pm on Sep 28, 2006 (gmt 0)
newpost thread iconRobots.txt & meta
  Robots meta tage or just a robots.txt
4pazang 7:45 pm on Sep 27, 2006 (gmt 0)
newpost thread iconDo excluded pages still count as links-in
 
3johnlod 8:14 pm on Sep 26, 2006 (gmt 0)
newpost thread iconOrder of lines in robots.txt file
  Can you control a bot with the order of the lines?
3bouncybunny 3:37 am on Sep 23, 2006 (gmt 0)
newpost thread iconrobots & blog
 
2zuses 2:54 pm on Sep 22, 2006 (gmt 0)
newpost thread iconKeeping robots out of cgi bin
  What's the best format?
10Reno 6:00 pm on Sep 21, 2006 (gmt 0)
newpost thread iconWhat user agent does Overture use?
  when they ping your page for quality
2Bewenched 8:35 pm on Sep 20, 2006 (gmt 0)
newpost thread iconRobots.txt help
 
2Northstar 7:50 pm on Sep 20, 2006 (gmt 0)
newpost thread iconNeed Help With Robots.txt Question
 
4BlueLeaf 4:23 am on Sep 19, 2006 (gmt 0)
newpost thread iconContrary advice over robots.txt validity
  Who is right Google or the other?
3netchicken1 1:05 pm on Sep 18, 2006 (gmt 0)
newpost thread iconDisallow page disallows variables, too?
  example.php and example.php?id=10
34string 8:50 pm on Sep 17, 2006 (gmt 0)
newpost thread iconindex, all?
 
3Boogalou 4:07 am on Sep 17, 2006 (gmt 0)
newpost thread iconDisallowing access to feed URLs
  Should I disallow access to feed and trackback URLs
1kektex 4:45 am on Sep 16, 2006 (gmt 0)
newpost thread iconExclude all robots on alias domains?
  Good idea or not?
1jtara 5:52 pm on Sep 15, 2006 (gmt 0)
newpost thread iconStrange way of writing robots.txt
  Has anybody use this?
2Cyclob 3:04 pm on Sep 15, 2006 (gmt 0)
newpost thread iconrobots.txt unreachable
  Error issued by Sitemaps
5apprentice 7:43 pm on Sep 9, 2006 (gmt 0)
newpost thread iconIS there any tool to find out the particular page got spidered?
  Help me
3geobals 8:50 pm on Sep 7, 2006 (gmt 0)
newpost thread iconRemove www. before sitename
 
4tigersoft 5:14 pm on Sep 7, 2006 (gmt 0)
newpost thread iconI think google can't access my pages.
 
6rj87uk 10:16 am on Sep 4, 2006 (gmt 0)
newpost thread iconBan IP range
 
3hostlead 9:18 pm on Sep 2, 2006 (gmt 0)
newpost thread iconSignature Spammer Bot?
  A pest on forums.
1helleborine 1:43 pm on Aug 29, 2006 (gmt 0)
Displaying Page 34 of 72<< Back 1 ... 24 25 26 27 28 29 30 31 32 33 [ 34 ] 35 36 37 38 39 40 41 42 43 ... 72 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved