homepage Welcome to WebmasterWorld Guest from 54.204.244.121
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconRobots.txt
  Ive never used robots.txt
4srobinson 3:21 am on Sep 23, 2008 (gmt 0)
newpost thread iconUnderstanding the structure of robots.txt
  subdirectories
10alahamdan 12:00 am on Sep 5, 2008 (gmt 0)
newpost thread iconBaiduspider - how do I keep it out.
  having some difficulty blocking this spider
3ChicagoFan67 1:44 pm on Sep 4, 2008 (gmt 0)
newpost thread iconrestrict special duplicate pages
 
4sixeleven 11:58 pm on Sep 3, 2008 (gmt 0)
newpost thread iconHow to set Slow GoogleBot Crawl Speed
  I need to fix Google to crawl my site as very slow or specifice times, how?
7Senthil 7:54 am on Aug 31, 2008 (gmt 0)
newpost thread iconErrors of robots.txt unreachable in google webmaster sitemap
  Please anyone help me
1pervezalam 9:35 am on Aug 29, 2008 (gmt 0)
newpost thread iconWhat is Robot.txt?
  What is robot.txt,
8deepk 7:16 am on Aug 21, 2008 (gmt 0)
newpost thread icondisallow & allow
 
3doumiao 6:14 am on Aug 15, 2008 (gmt 0)
newpost thread iconRegular Expressions, robots.txt, and robotstxt.org
 
4Funtick 7:24 pm on Aug 14, 2008 (gmt 0)
newpost thread iconHow to disallow https urls
  How to disallow https urls
6spiritualseo 8:39 pm on Aug 12, 2008 (gmt 0)
newpost thread iconURLs restricted by robots.txt
  How to remove that restricton or reinclude URL
2Raheel 2:28 pm on Aug 9, 2008 (gmt 0)
newpost thread icongoogle search box
 
1sixeleven 3:10 pm on Aug 8, 2008 (gmt 0)
newpost thread iconGoogle has indexed my sitemap.xml
  sitemap.xml appears as first result in serps for my domain
2wrightee 1:20 pm on Aug 4, 2008 (gmt 0)
newpost thread iconHow to disallow subfolders
 
3bonagiri 10:03 am on Jul 29, 2008 (gmt 0)
newpost thread iconMy website ranking dropped!
  after i create a wrong robotx.txt...
9virtualreality 1:07 am on Jul 29, 2008 (gmt 0)
newpost thread iconBlocking parts of forum
  but not others
11AnonyMouse 8:24 pm on Jul 28, 2008 (gmt 0)
newpost thread iconi should disallow ,second pages?
 
3sixeleven 2:37 pm on Jul 25, 2008 (gmt 0)
newpost thread iconHow to disallow search results
  How to disallow search results
6spiritualseo 2:01 pm on Jul 17, 2008 (gmt 0)
newpost thread iconDiscrepancy between Webmaster Tools robots.txt analysis and reality
 
6fishfinger 10:05 am on Jul 14, 2008 (gmt 0)
newpost thread icongooglebot sitemap question
  thinking about submitting sitemap, but not decided yet
5cirlong 2:38 pm on Jul 13, 2008 (gmt 0)
newpost thread iconRobots.txt code sensitive to missed spaces?
 
6Marketing_Guy 2:48 pm on Jul 11, 2008 (gmt 0)
newpost thread iconGoogleBot muxing URLS and I want to block it
 
6webdude 2:29 pm on Jul 11, 2008 (gmt 0)
newpost thread iconHow to block this URLs
 
3vreelmistee 2:26 pm on Jul 11, 2008 (gmt 0)
newpost thread iconblocking certain files with robots.txt?
 
5htdawg 2:26 pm on Jul 11, 2008 (gmt 0)
newpost thread iconUsing Wildcat
 
2stormshield 5:13 pm on Jul 6, 2008 (gmt 0)
Displaying Page 23 of 72<< Back 1 ... 13 14 15 16 17 18 19 20 21 22 [ 23 ] 24 25 26 27 28 29 30 31 32 ... 72 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved