homepage Welcome to WebmasterWorld Guest from 184.73.52.98
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconRobots.txt help
 
2Northstar 7:50 pm on Sep 20, 2006 (gmt 0)
newpost thread iconNeed Help With Robots.txt Question
 
4BlueLeaf 4:23 am on Sep 19, 2006 (gmt 0)
newpost thread iconContrary advice over robots.txt validity
  Who is right Google or the other?
3netchicken1 1:05 pm on Sep 18, 2006 (gmt 0)
newpost thread iconDisallow page disallows variables, too?
  example.php and example.php?id=10
34string 8:50 pm on Sep 17, 2006 (gmt 0)
newpost thread iconindex, all?
 
3Boogalou 4:07 am on Sep 17, 2006 (gmt 0)
newpost thread iconDisallowing access to feed URLs
  Should I disallow access to feed and trackback URLs
1kektex 4:45 am on Sep 16, 2006 (gmt 0)
newpost thread iconExclude all robots on alias domains?
  Good idea or not?
1jtara 5:52 pm on Sep 15, 2006 (gmt 0)
newpost thread iconStrange way of writing robots.txt
  Has anybody use this?
2Cyclob 3:04 pm on Sep 15, 2006 (gmt 0)
newpost thread iconrobots.txt unreachable
  Error issued by Sitemaps
5apprentice 7:43 pm on Sep 9, 2006 (gmt 0)
newpost thread iconIS there any tool to find out the particular page got spidered?
  Help me
3geobals 8:50 pm on Sep 7, 2006 (gmt 0)
newpost thread iconRemove www. before sitename
 
4tigersoft 5:14 pm on Sep 7, 2006 (gmt 0)
newpost thread iconI think google can't access my pages.
 
6rj87uk 10:16 am on Sep 4, 2006 (gmt 0)
newpost thread iconBan IP range
 
3hostlead 9:18 pm on Sep 2, 2006 (gmt 0)
newpost thread iconSignature Spammer Bot?
  A pest on forums.
1helleborine 1:43 pm on Aug 29, 2006 (gmt 0)
newpost thread iconRobots/Site maps
 
1dave1236 1:51 pm on Aug 28, 2006 (gmt 0)
newpost thread iconPossible with robots.txt?
  Possible with robots.txt?
2Aforum 9:22 am on Aug 28, 2006 (gmt 0)
newpost thread iconDo i need robot.txt on my site
  robot.txt-is it needed & how to add it
5Amitbud 1:46 pm on Aug 25, 2006 (gmt 0)
newpost thread iconPrevent spider from following external links
  to keep Amazon items out of search engine database
2Reno 7:11 am on Aug 25, 2006 (gmt 0)
newpost thread iconRobots txt to remove pages
  Does google still look at urls blocked
3cheaperholidays 7:56 am on Aug 24, 2006 (gmt 0)
newpost thread iconWhere do I find the Robot Validation Tool?
  robot validator validation robots
7myebux 9:45 pm on Aug 23, 2006 (gmt 0)
newpost thread iconNeed advice on my robots.txt file
  new to robots.txt, can someone check this file
4jwa55121 5:07 pm on Aug 22, 2006 (gmt 0)
newpost thread iconAre there any tricky uses of robot.txt file?
  robot.xt file to be indexed by SEs?
4yuvika 8:47 am on Aug 22, 2006 (gmt 0)
newpost thread iconNew spider that is actually good.
  found a "good" new spider
1jcrimi 12:10 am on Aug 22, 2006 (gmt 0)
newpost thread iconrobot.txt
  problem disallowing pages in home directory
2surfpro203 2:23 am on Aug 16, 2006 (gmt 0)
newpost thread iconFlash web site - need for robots.txt?
  I have a web site in Flash - is it necessary to have a robots.txt file?
2Cratima 1:05 pm on Aug 15, 2006 (gmt 0)
Displaying Page 34 of 71<< Back 1 ... 24 25 26 27 28 29 30 31 32 33 [ 34 ] 35 36 37 38 39 40 41 42 43 ... 71 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
© Webmaster World 1996-2014 all rights reserved