homepage Welcome to WebmasterWorld Guest from 54.205.189.156
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Subscribe to WebmasterWorld
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconOrder of lines in robots.txt file
  Can you control a bot with the order of the lines?
3bouncybunny 3:37 am on Sep 23, 2006 (gmt 0)
newpost thread iconrobots & blog
 
2zuses 2:54 pm on Sep 22, 2006 (gmt 0)
newpost thread iconKeeping robots out of cgi bin
  What's the best format?
10Reno 6:00 pm on Sep 21, 2006 (gmt 0)
newpost thread iconWhat user agent does Overture use?
  when they ping your page for quality
2Bewenched 8:35 pm on Sep 20, 2006 (gmt 0)
newpost thread iconRobots.txt help
 
2Northstar 7:50 pm on Sep 20, 2006 (gmt 0)
newpost thread iconNeed Help With Robots.txt Question
 
4BlueLeaf 4:23 am on Sep 19, 2006 (gmt 0)
newpost thread iconContrary advice over robots.txt validity
  Who is right Google or the other?
3netchicken1 1:05 pm on Sep 18, 2006 (gmt 0)
newpost thread iconDisallow page disallows variables, too?
  example.php and example.php?id=10
34string 8:50 pm on Sep 17, 2006 (gmt 0)
newpost thread iconindex, all?
 
3Boogalou 4:07 am on Sep 17, 2006 (gmt 0)
newpost thread iconDisallowing access to feed URLs
  Should I disallow access to feed and trackback URLs
1kektex 4:45 am on Sep 16, 2006 (gmt 0)
newpost thread iconExclude all robots on alias domains?
  Good idea or not?
1jtara 5:52 pm on Sep 15, 2006 (gmt 0)
newpost thread iconStrange way of writing robots.txt
  Has anybody use this?
2Cyclob 3:04 pm on Sep 15, 2006 (gmt 0)
newpost thread iconrobots.txt unreachable
  Error issued by Sitemaps
5apprentice 7:43 pm on Sep 9, 2006 (gmt 0)
newpost thread iconIS there any tool to find out the particular page got spidered?
  Help me
3geobals 8:50 pm on Sep 7, 2006 (gmt 0)
newpost thread iconRemove www. before sitename
 
4tigersoft 5:14 pm on Sep 7, 2006 (gmt 0)
newpost thread iconI think google can't access my pages.
 
6rj87uk 10:16 am on Sep 4, 2006 (gmt 0)
newpost thread iconBan IP range
 
3hostlead 9:18 pm on Sep 2, 2006 (gmt 0)
newpost thread iconSignature Spammer Bot?
  A pest on forums.
1helleborine 1:43 pm on Aug 29, 2006 (gmt 0)
newpost thread iconRobots/Site maps
 
1dave1236 1:51 pm on Aug 28, 2006 (gmt 0)
newpost thread iconPossible with robots.txt?
  Possible with robots.txt?
2Aforum 9:22 am on Aug 28, 2006 (gmt 0)
newpost thread iconDo i need robot.txt on my site
  robot.txt-is it needed & how to add it
5Amitbud 1:46 pm on Aug 25, 2006 (gmt 0)
newpost thread iconPrevent spider from following external links
  to keep Amazon items out of search engine database
2Reno 7:11 am on Aug 25, 2006 (gmt 0)
newpost thread iconRobots txt to remove pages
  Does google still look at urls blocked
3cheaperholidays 7:56 am on Aug 24, 2006 (gmt 0)
newpost thread iconWhere do I find the Robot Validation Tool?
  robot validator validation robots
7myebux 9:45 pm on Aug 23, 2006 (gmt 0)
newpost thread iconNeed advice on my robots.txt file
  new to robots.txt, can someone check this file
4jwa55121 5:07 pm on Aug 22, 2006 (gmt 0)
Displaying Page 34 of 71<< Back 1 ... 24 25 26 27 28 29 30 31 32 33 [ 34 ] 35 36 37 38 39 40 41 42 43 ... 71 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved