homepage Welcome to WebmasterWorld Guest from 54.211.95.201
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconSiteMap and Robots.txt Indexing
  What is the right way to avoid it?
5kitamed 3:49 pm on Nov 6, 2009 (gmt 0)
newpost thread iconGoogle Sitemap Indexed URLs going down
 
4themoron1 1:12 pm on Nov 6, 2009 (gmt 0)
newpost thread iconProblems crawling my pages for XML Sitemap
  Spider simulators (all of them) seem to struggle
1Munster 12:15 pm on Nov 5, 2009 (gmt 0)
newpost thread iconHow to stop search engines caching my webpages?
 
11gcan 4:31 am on Nov 2, 2009 (gmt 0)
newpost thread iconindex.html
  redirect in htaccess file
3anyone 3:53 pm on Oct 29, 2009 (gmt 0)
newpost thread iconWill URLs blocked in robots.txt remove currently indexed pages?
 
6limitup 12:20 am on Oct 28, 2009 (gmt 0)
newpost thread iconNoindex and also Changeing 2 million URL's
 
2azn_romeo_4u 10:53 am on Oct 27, 2009 (gmt 0)
newpost thread iconBlocked Shot - Robots.txt
  blocking numerous duplicate pages using robots.txt
6underglass 10:50 am on Oct 27, 2009 (gmt 0)
newpost thread iconNeed a Sitemap Generator
 
2eljuan 8:52 pm on Oct 26, 2009 (gmt 0)
newpost thread iconsite map generator program
  site map generator
7Roobik 12:27 pm on Oct 26, 2009 (gmt 0)
newpost thread iconWebmaster Tools Issues - Need Help
  Webmaster tools showing data that does not reflect in Google
3ranadeep 7:16 am on Oct 22, 2009 (gmt 0)
newpost thread iconmeta name="allow search" content="yes"
  do i really need this tag now?
4supafresh 1:52 am on Oct 20, 2009 (gmt 0)
newpost thread iconQuestion concerning Disallow and *
 
4augustwind 1:44 am on Oct 20, 2009 (gmt 0)
newpost thread iconWhich Is The Better Way To Handle Site Title
  Which is the better way to handle the site title.
4Robert 11:40 pm on Oct 18, 2009 (gmt 0)
newpost thread iconWebmaster URL Removal Issues
  Robots file/URL removal issues
10MarkWW 3:24 pm on Oct 13, 2009 (gmt 0)
newpost thread iconDifferent content on the same URL
  Users language is stored in a cookie - website displays different content o
3gcan 9:23 pm on Oct 12, 2009 (gmt 0)
newpost thread iconWhy search engines are showing the wrong meta title & description
  Metadata was correct two months ago but now search engine showing wrong.
4Kash 2:36 pm on Oct 12, 2009 (gmt 0)
newpost thread iconQuestion about robots.txt file
  It is blank
2iGLOBAL_NiCK 2:45 am on Oct 12, 2009 (gmt 0)
newpost thread iconallowing google bot only to index URL with parameters
 
2ulmudmezig 7:12 pm on Oct 8, 2009 (gmt 0)
newpost thread iconGoogle Webmaster Tools - Domain Not Found
 
1kflanagan 9:25 am on Oct 6, 2009 (gmt 0)
newpost thread iconRobots.txt and allow and $
  Advanced question
3djingo 12:43 pm on Oct 1, 2009 (gmt 0)
newpost thread iconIndex pages: site:www.abc.com vs Google Sitemap(Webmastertools)
  Why there's a huge difference between the two?
2Singhvineet 1:28 pm on Sep 29, 2009 (gmt 0)
newpost thread iconGoogle not obeying robots.txt
  Disallow: /*? not going through
4smallcompany 4:48 am on Sep 26, 2009 (gmt 0)
newpost thread iconSuccessful 301 Redirection?
  Switching a website to an entirely new technology, URLS, etc
5supermanu 2:39 am on Sep 23, 2009 (gmt 0)
newpost thread iconIs Pinging Google a crime ?
 
5kinley 8:46 am on Sep 20, 2009 (gmt 0)
Displaying Page 15 of 71<< Back 1 ... 5 6 7 8 9 10 11 12 13 14 [ 15 ] 16 17 18 19 20 21 22 23 24 ... 71 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved