homepage Welcome to WebmasterWorld Guest from 54.226.235.222
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconRemoved 'deny all' robots.txt but no change
 
2kapow 11:03 pm on Oct 23, 2004 (gmt 0)
newpost thread iconWhat name does msn's spider use?
  Lots of visits from yahoo and google....but not msn
2David_Bruning 7:05 am on Oct 19, 2004 (gmt 0)
newpost thread iconRobots.txt? (removing a specific subdirectory from google index...)
 
3hugo_guzman 8:06 pm on Oct 18, 2004 (gmt 0)
newpost thread iconMore help in robots.txt
  robots.txt
2sakuramy 1:25 pm on Oct 18, 2004 (gmt 0)
newpost thread iconrobots.txt validator
  Error, Error, Error loads of them
7hatap 12:45 pm on Oct 18, 2004 (gmt 0)
newpost thread iconAllowing some bots, disallowing all others
 
2xbase234 5:16 pm on Oct 16, 2004 (gmt 0)
newpost thread iconRobot Help
 
5Stra 4:41 pm on Oct 16, 2004 (gmt 0)
newpost thread iconStop image bot from indexing my images
 
2ladyluck 1:17 pm on Oct 14, 2004 (gmt 0)
newpost thread iconQuick help with robots.txt please?
  where to put the file?
2LadyTi 2:20 pm on Oct 13, 2004 (gmt 0)
newpost thread iconrobots.txt to stop some domains
  How to allow only one domain to be indexed for the same website.
5john_pinx 3:39 am on Oct 12, 2004 (gmt 0)
newpost thread iconduhhhhh, dumb blonde needing help with robot.txt
  I don't have a clue - go easy please....
4ladyluck 6:37 am on Oct 9, 2004 (gmt 0)
newpost thread iconHow to Disallow a Particular Page
 
5jsnively 9:25 pm on Oct 6, 2004 (gmt 0)
newpost thread iconhacking robots.txt for RSS features?
 
1phildog 3:53 pm on Oct 4, 2004 (gmt 0)
newpost thread iconIs robots.txt always needed?
  robots.txt
10benwalsh 12:38 pm on Oct 4, 2004 (gmt 0)
newpost thread iconbad bots
 
4rhodopsin 11:40 am on Oct 3, 2004 (gmt 0)
newpost thread iconInsert disallow.php to robots
  is it a good idea?
3sirkei 5:52 am on Oct 3, 2004 (gmt 0)
newpost thread iconCan i add robot txt to a free hosting site? keywords
 
2alze 5:14 am on Oct 3, 2004 (gmt 0)
newpost thread iconDoes robots.txt prevent all access?
  ...on page as well as directory.
2yump 5:02 am on Oct 3, 2004 (gmt 0)
newpost thread iconRobots.txt sabotage
  Common? How to protect?
4adfree 11:05 am on Sep 30, 2004 (gmt 0)
newpost thread iconnewbie to robots.txt, want to exclude /images/
  excluding some image folders but not others
2franco81 3:29 am on Sep 30, 2004 (gmt 0)
newpost thread iconNewbie - Why wouldn't I want to allow certain robots?
  If I don't have anything on the site I want to keep private
4AmyG 4:03 pm on Sep 29, 2004 (gmt 0)
newpost thread iconWhat if your domains robots.txt
  Was pointed to your domain?
5Daily_Sparring 3:22 am on Sep 27, 2004 (gmt 0)
newpost thread iconWhere to put robots in website?
  I has doubt where to put robots.
3viva 10:00 am on Sep 26, 2004 (gmt 0)
newpost thread iconrobots.txt and .htaccess
 
1HuhuFruFru 12:02 am on Sep 26, 2004 (gmt 0)
newpost thread iconExcluding Sub Folders
  When you exclude a folder, are folders inside that excluded also?
3damlag 8:39 pm on Sep 25, 2004 (gmt 0)
Displaying Page 54 of 71<< Back 1 ... 44 45 46 47 48 49 50 51 52 53 [ 54 ] 55 56 57 58 59 60 61 62 63 ... 71 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved