homepage Welcome to WebmasterWorld Guest from 54.161.191.154
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconGoogle Sitemap Generator installs - but I can't configure it!
 
1webpro00801 4:56 pm on Nov 9, 2009 (gmt 0)
newpost thread iconMy last two new pages from blog not indexed (first time for years)
 
3tomda 6:23 am on Nov 9, 2009 (gmt 0)
newpost thread iconStop Subdomain Indexing
  My Development Subdomain Being Indexed
2vetofunk 11:01 pm on Nov 8, 2009 (gmt 0)
newpost thread iconhttp:/ / translate. googleusercontent. com/ translate c
 
1nomis5 11:10 am on Nov 7, 2009 (gmt 0)
newpost thread iconSitemap "Priority" and bot behavior
  Will the priority attribute affect how spiders crawl?
3arieng 6:07 pm on Nov 6, 2009 (gmt 0)
newpost thread iconSiteMap and Robots.txt Indexing
  What is the right way to avoid it?
5kitamed 3:49 pm on Nov 6, 2009 (gmt 0)
newpost thread iconGoogle Sitemap Indexed URLs going down
 
4themoron1 1:12 pm on Nov 6, 2009 (gmt 0)
newpost thread iconProblems crawling my pages for XML Sitemap
  Spider simulators (all of them) seem to struggle
1Munster 12:15 pm on Nov 5, 2009 (gmt 0)
newpost thread iconHow to stop search engines caching my webpages?
 
11gcan 4:31 am on Nov 2, 2009 (gmt 0)
newpost thread iconindex.html
  redirect in htaccess file
3anyone 3:53 pm on Oct 29, 2009 (gmt 0)
newpost thread iconWill URLs blocked in robots.txt remove currently indexed pages?
 
6limitup 12:20 am on Oct 28, 2009 (gmt 0)
newpost thread iconNoindex and also Changeing 2 million URL's
 
2azn_romeo_4u 10:53 am on Oct 27, 2009 (gmt 0)
newpost thread iconBlocked Shot - Robots.txt
  blocking numerous duplicate pages using robots.txt
6underglass 10:50 am on Oct 27, 2009 (gmt 0)
newpost thread iconNeed a Sitemap Generator
 
2eljuan 8:52 pm on Oct 26, 2009 (gmt 0)
newpost thread iconsite map generator program
  site map generator
7Roobik 12:27 pm on Oct 26, 2009 (gmt 0)
newpost thread iconWebmaster Tools Issues - Need Help
  Webmaster tools showing data that does not reflect in Google
3ranadeep 7:16 am on Oct 22, 2009 (gmt 0)
newpost thread iconmeta name="allow search" content="yes"
  do i really need this tag now?
4supafresh 1:52 am on Oct 20, 2009 (gmt 0)
newpost thread iconQuestion concerning Disallow and *
 
4augustwind 1:44 am on Oct 20, 2009 (gmt 0)
newpost thread iconWhich Is The Better Way To Handle Site Title
  Which is the better way to handle the site title.
4Robert 11:40 pm on Oct 18, 2009 (gmt 0)
newpost thread iconWebmaster URL Removal Issues
  Robots file/URL removal issues
10MarkWW 3:24 pm on Oct 13, 2009 (gmt 0)
newpost thread iconDifferent content on the same URL
  Users language is stored in a cookie - website displays different content o
3gcan 9:23 pm on Oct 12, 2009 (gmt 0)
newpost thread iconWhy search engines are showing the wrong meta title & description
  Metadata was correct two months ago but now search engine showing wrong.
4Kash 2:36 pm on Oct 12, 2009 (gmt 0)
newpost thread iconQuestion about robots.txt file
  It is blank
2iGLOBAL_NiCK 2:45 am on Oct 12, 2009 (gmt 0)
newpost thread iconallowing google bot only to index URL with parameters
 
2ulmudmezig 7:12 pm on Oct 8, 2009 (gmt 0)
newpost thread iconGoogle Webmaster Tools - Domain Not Found
 
1kflanagan 9:25 am on Oct 6, 2009 (gmt 0)
Displaying Page 15 of 72<< Back 1 ... 5 6 7 8 9 10 11 12 13 14 [ 15 ] 16 17 18 19 20 21 22 23 24 ... 72 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved