homepage Welcome to WebmasterWorld Guest from 54.211.34.105
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconQuerystring check
 
2papamaku 9:36 am on Nov 2, 2004 (gmt 0)
newpost thread iconrobots and nav bars
  excluding links in nav bars ...
2f00fighter 11:38 pm on Oct 29, 2004 (gmt 0)
newpost thread iconNeed assistance with robot controls
  need help with a robot .txt file
2borkboing 11:31 pm on Oct 29, 2004 (gmt 0)
newpost thread iconRobots.txt not working
  bots not obeying robots.txt
4cyberjunkie 11:05 pm on Oct 29, 2004 (gmt 0)
newpost thread iconUse .htaccess to serve correct robots.txt?
  Using htaccess and robots.txt to elimiate file duplication and 404 errors
2iceman 12:05 am on Oct 26, 2004 (gmt 0)
newpost thread iconRobots detection tool?
 
2obsos 1:17 am on Oct 25, 2004 (gmt 0)
newpost thread iconrobots.txt vs index,follow
  Who will win?
3brakkar 6:13 pm on Oct 24, 2004 (gmt 0)
newpost thread iconRemoved 'deny all' robots.txt but no change
 
2kapow 11:03 pm on Oct 23, 2004 (gmt 0)
newpost thread iconWhat name does msn's spider use?
  Lots of visits from yahoo and google....but not msn
2David_Bruning 7:05 am on Oct 19, 2004 (gmt 0)
newpost thread iconRobots.txt? (removing a specific subdirectory from google index...)
 
3hugo_guzman 8:06 pm on Oct 18, 2004 (gmt 0)
newpost thread iconMore help in robots.txt
  robots.txt
2sakuramy 1:25 pm on Oct 18, 2004 (gmt 0)
newpost thread iconrobots.txt validator
  Error, Error, Error loads of them
7hatap 12:45 pm on Oct 18, 2004 (gmt 0)
newpost thread iconAllowing some bots, disallowing all others
 
2xbase234 5:16 pm on Oct 16, 2004 (gmt 0)
newpost thread iconRobot Help
 
5Stra 4:41 pm on Oct 16, 2004 (gmt 0)
newpost thread iconStop image bot from indexing my images
 
2ladyluck 1:17 pm on Oct 14, 2004 (gmt 0)
newpost thread iconQuick help with robots.txt please?
  where to put the file?
2LadyTi 2:20 pm on Oct 13, 2004 (gmt 0)
newpost thread iconrobots.txt to stop some domains
  How to allow only one domain to be indexed for the same website.
5john_pinx 3:39 am on Oct 12, 2004 (gmt 0)
newpost thread iconduhhhhh, dumb blonde needing help with robot.txt
  I don't have a clue - go easy please....
4ladyluck 6:37 am on Oct 9, 2004 (gmt 0)
newpost thread iconHow to Disallow a Particular Page
 
5jsnively 9:25 pm on Oct 6, 2004 (gmt 0)
newpost thread iconhacking robots.txt for RSS features?
 
1phildog 3:53 pm on Oct 4, 2004 (gmt 0)
newpost thread iconIs robots.txt always needed?
  robots.txt
10benwalsh 12:38 pm on Oct 4, 2004 (gmt 0)
newpost thread iconbad bots
 
4rhodopsin 11:40 am on Oct 3, 2004 (gmt 0)
newpost thread iconInsert disallow.php to robots
  is it a good idea?
3sirkei 5:52 am on Oct 3, 2004 (gmt 0)
newpost thread iconCan i add robot txt to a free hosting site? keywords
 
2alze 5:14 am on Oct 3, 2004 (gmt 0)
newpost thread iconDoes robots.txt prevent all access?
  ...on page as well as directory.
2yump 5:02 am on Oct 3, 2004 (gmt 0)
Displaying Page 54 of 72<< Back 1 ... 44 45 46 47 48 49 50 51 52 53 [ 54 ] 55 56 57 58 59 60 61 62 63 ... 72 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved