homepage Welcome to WebmasterWorld Guest from 50.16.112.199
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconRobots.txt not functioning!
  Added the file months ago but results still coming up
4nwhorton 6:55 pm on Nov 28, 2005 (gmt 0)
newpost thread iconlist of robots to disallow that actually obey robots.txt
 
1koen 3:32 pm on Nov 28, 2005 (gmt 0)
newpost thread icondoes robots.txt really effect ranking?
 
2goneinthesun 4:44 pm on Nov 26, 2005 (gmt 0)
newpost thread iconForce spider to revisit sooner?
  Robots instructions help.
4Fuzzi_Bear 2:32 pm on Nov 26, 2005 (gmt 0)
newpost thread iconGeting lots of hits on robots.txt but not much indexes in Yahoo/Google
 
8ball4121 4:47 am on Nov 26, 2005 (gmt 0)
newpost thread iconsimple robots.txt question
  just to make sure
5followgreg 4:24 am on Nov 26, 2005 (gmt 0)
newpost thread iconRobots.txt Vs META name="robots"
  Which is better?
4Fuzzi_Bear 8:46 pm on Nov 25, 2005 (gmt 0)
newpost thread iconQuick robots.txt help
  is this the right syntax?
3Fuzzi_Bear 2:17 pm on Nov 25, 2005 (gmt 0)
newpost thread iconban all robots for a short period
 
11digicam 6:02 pm on Nov 23, 2005 (gmt 0)
newpost thread iconWebmasterWorld robots.txt
 
5phpmaven 4:45 pm on Nov 23, 2005 (gmt 0)
newpost thread iconMobile content
  Mobile content might be seen as Duplicate.
1designasp 12:41 am on Nov 23, 2005 (gmt 0)
newpost thread iconGap - how many days
 
4successlieswithme 9:39 am on Nov 22, 2005 (gmt 0)
newpost thread iconwhy has google not removed these url's
 
3fzx5v0 3:48 am on Nov 21, 2005 (gmt 0)
newpost thread iconCapitalize robots.txt filename?
  Robots.txt or robots.txt
34string 4:18 am on Nov 17, 2005 (gmt 0)
newpost thread iconNeed help removing multiple pages
 
3tintin74 11:00 am on Nov 15, 2005 (gmt 0)
newpost thread iconHelp with Disallow
  Not sure if I got this right...
3BillyS 8:52 pm on Nov 14, 2005 (gmt 0)
newpost thread iconstop Yahoo's crawler but for specific domains
  how to stop yahoo's crawler for specif domains
2nrueda 11:40 pm on Nov 8, 2005 (gmt 0)
newpost thread iconwildcard for googlebot
 
4fzx5v0 4:02 pm on Nov 7, 2005 (gmt 0)
newpost thread iconProposing updates to the robots.txt standard
  It is time for a change
16volatilegx 9:20 pm on Nov 4, 2005 (gmt 0)
newpost thread iconwhat i did wrong?
 
5fluxer 3:45 pm on Nov 4, 2005 (gmt 0)
newpost thread iconprotected ffiles and robots
 
2StickeR 7:48 pm on Nov 3, 2005 (gmt 0)
newpost thread iconExculde php url with vars using robots.txt
  Exclude urls with vars using robots.txt
2alexmart 7:44 pm on Nov 3, 2005 (gmt 0)
newpost thread iconIs Temporary Disallow a Problem Later?
 
6bumpaw 2:10 pm on Nov 3, 2005 (gmt 0)
newpost thread icondisallow problem
 
7Autoweb 8:25 am on Nov 3, 2005 (gmt 0)
newpost thread iconAdded robots.txt - 3 days later rankings gone!
 
11Block19Row13 3:45 pm on Nov 2, 2005 (gmt 0)
Displaying Page 42 of 72<< Back 1 ... 32 33 34 35 36 37 38 39 40 41 [ 42 ] 43 44 45 46 47 48 49 50 51 ... 72 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved