homepage Welcome to WebmasterWorld Guest from 54.221.175.46
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconRobots - Allowing them
  rather than disallow
2SanDiegoPaul 10:30 pm on Sep 28, 2006 (gmt 0)
newpost thread iconRobots.txt & meta
  Robots meta tage or just a robots.txt
4pazang 7:45 pm on Sep 27, 2006 (gmt 0)
newpost thread iconDo excluded pages still count as links-in
 
3johnlod 8:14 pm on Sep 26, 2006 (gmt 0)
newpost thread iconOrder of lines in robots.txt file
  Can you control a bot with the order of the lines?
3bouncybunny 3:37 am on Sep 23, 2006 (gmt 0)
newpost thread iconrobots & blog
 
2zuses 2:54 pm on Sep 22, 2006 (gmt 0)
newpost thread iconKeeping robots out of cgi bin
  What's the best format?
10Reno 6:00 pm on Sep 21, 2006 (gmt 0)
newpost thread iconWhat user agent does Overture use?
  when they ping your page for quality
2Bewenched 8:35 pm on Sep 20, 2006 (gmt 0)
newpost thread iconRobots.txt help
 
2Northstar 7:50 pm on Sep 20, 2006 (gmt 0)
newpost thread iconNeed Help With Robots.txt Question
 
4BlueLeaf 4:23 am on Sep 19, 2006 (gmt 0)
newpost thread iconContrary advice over robots.txt validity
  Who is right Google or the other?
3netchicken1 1:05 pm on Sep 18, 2006 (gmt 0)
newpost thread iconDisallow page disallows variables, too?
  example.php and example.php?id=10
34string 8:50 pm on Sep 17, 2006 (gmt 0)
newpost thread iconindex, all?
 
3Boogalou 4:07 am on Sep 17, 2006 (gmt 0)
newpost thread iconDisallowing access to feed URLs
  Should I disallow access to feed and trackback URLs
1kektex 4:45 am on Sep 16, 2006 (gmt 0)
newpost thread iconExclude all robots on alias domains?
  Good idea or not?
1jtara 5:52 pm on Sep 15, 2006 (gmt 0)
newpost thread iconStrange way of writing robots.txt
  Has anybody use this?
2Cyclob 3:04 pm on Sep 15, 2006 (gmt 0)
newpost thread iconrobots.txt unreachable
  Error issued by Sitemaps
5apprentice 7:43 pm on Sep 9, 2006 (gmt 0)
newpost thread iconIS there any tool to find out the particular page got spidered?
  Help me
3geobals 8:50 pm on Sep 7, 2006 (gmt 0)
newpost thread iconRemove www. before sitename
 
4tigersoft 5:14 pm on Sep 7, 2006 (gmt 0)
newpost thread iconI think google can't access my pages.
 
6rj87uk 10:16 am on Sep 4, 2006 (gmt 0)
newpost thread iconBan IP range
 
3hostlead 9:18 pm on Sep 2, 2006 (gmt 0)
newpost thread iconSignature Spammer Bot?
  A pest on forums.
1helleborine 1:43 pm on Aug 29, 2006 (gmt 0)
newpost thread iconRobots/Site maps
 
1dave1236 1:51 pm on Aug 28, 2006 (gmt 0)
newpost thread iconPossible with robots.txt?
  Possible with robots.txt?
2Aforum 9:22 am on Aug 28, 2006 (gmt 0)
newpost thread iconDo i need robot.txt on my site
  robot.txt-is it needed & how to add it
5Amitbud 1:46 pm on Aug 25, 2006 (gmt 0)
newpost thread iconPrevent spider from following external links
  to keep Amazon items out of search engine database
2Reno 7:11 am on Aug 25, 2006 (gmt 0)
Displaying Page 34 of 71<< Back 1 ... 24 25 26 27 28 29 30 31 32 33 [ 34 ] 35 36 37 38 39 40 41 42 43 ... 71 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved