homepage Welcome to WebmasterWorld Guest from 54.204.67.26
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconBan Google from 1 directory
  Ban Google from 1 directory
2dunhill 6:47 am on Nov 30, 2005 (gmt 0)
newpost thread iconYahoo Ignoring robots.txt
  Anyone know how to get Yahoo....
2marketingmagic 8:23 pm on Nov 29, 2005 (gmt 0)
newpost thread iconnoimageindex?
  How do I allow a page to be cached without right clicking allowed?
3NeedALife 7:44 pm on Nov 29, 2005 (gmt 0)
newpost thread iconRobots.txt not functioning!
  Added the file months ago but results still coming up
4nwhorton 6:55 pm on Nov 28, 2005 (gmt 0)
newpost thread iconlist of robots to disallow that actually obey robots.txt
 
1koen 3:32 pm on Nov 28, 2005 (gmt 0)
newpost thread icondoes robots.txt really effect ranking?
 
2goneinthesun 4:44 pm on Nov 26, 2005 (gmt 0)
newpost thread iconForce spider to revisit sooner?
  Robots instructions help.
4Fuzzi_Bear 2:32 pm on Nov 26, 2005 (gmt 0)
newpost thread iconGeting lots of hits on robots.txt but not much indexes in Yahoo/Google
 
8ball4121 4:47 am on Nov 26, 2005 (gmt 0)
newpost thread iconsimple robots.txt question
  just to make sure
5followgreg 4:24 am on Nov 26, 2005 (gmt 0)
newpost thread iconRobots.txt Vs META name="robots"
  Which is better?
4Fuzzi_Bear 8:46 pm on Nov 25, 2005 (gmt 0)
newpost thread iconQuick robots.txt help
  is this the right syntax?
3Fuzzi_Bear 2:17 pm on Nov 25, 2005 (gmt 0)
newpost thread iconban all robots for a short period
 
11digicam 6:02 pm on Nov 23, 2005 (gmt 0)
newpost thread iconWebmasterWorld robots.txt
 
5phpmaven 4:45 pm on Nov 23, 2005 (gmt 0)
newpost thread iconMobile content
  Mobile content might be seen as Duplicate.
1designasp 12:41 am on Nov 23, 2005 (gmt 0)
newpost thread iconGap - how many days
 
4successlieswithme 9:39 am on Nov 22, 2005 (gmt 0)
newpost thread iconwhy has google not removed these url's
 
3fzx5v0 3:48 am on Nov 21, 2005 (gmt 0)
newpost thread iconCapitalize robots.txt filename?
  Robots.txt or robots.txt
34string 4:18 am on Nov 17, 2005 (gmt 0)
newpost thread iconNeed help removing multiple pages
 
3tintin74 11:00 am on Nov 15, 2005 (gmt 0)
newpost thread iconHelp with Disallow
  Not sure if I got this right...
3BillyS 8:52 pm on Nov 14, 2005 (gmt 0)
newpost thread iconstop Yahoo's crawler but for specific domains
  how to stop yahoo's crawler for specif domains
2nrueda 11:40 pm on Nov 8, 2005 (gmt 0)
newpost thread iconwildcard for googlebot
 
4fzx5v0 4:02 pm on Nov 7, 2005 (gmt 0)
newpost thread iconProposing updates to the robots.txt standard
  It is time for a change
16volatilegx 9:20 pm on Nov 4, 2005 (gmt 0)
newpost thread iconwhat i did wrong?
 
5fluxer 3:45 pm on Nov 4, 2005 (gmt 0)
newpost thread iconprotected ffiles and robots
 
2StickeR 7:48 pm on Nov 3, 2005 (gmt 0)
newpost thread iconExculde php url with vars using robots.txt
  Exclude urls with vars using robots.txt
2alexmart 7:44 pm on Nov 3, 2005 (gmt 0)
Displaying Page 41 of 71<< Back 1 ... 31 32 33 34 35 36 37 38 39 40 [ 41 ] 42 43 44 45 46 47 48 49 50 ... 71 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
© Webmaster World 1996-2014 all rights reserved