Welcome to WebmasterWorld Guest from 184.108.40.206
Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.
|Thread Subject||Messages||Started by||Last Message|
|Robots.txt vs Noindex for Used Car Listings
Robots.txt or noindex for duplicate used vehicle listings
|1||browndawg||7:21 pm Jan 23, 2014|
|Why Xml Sitemap is preferred over HTML sitemap
||3||narenfomax||5:06 pm Jan 6, 2014|
|XML Sitemap creator for 100,000K + pages
||3||Compworld||8:35 am Jan 3, 2014|
|issue indexing xml sitemap in google webmaster tools
xml sitemaps are not being indexed since last week
|4||Olinda_Luksen||4:38 am Dec 22, 2013|
Can we give it another name
|8||bilalseo||5:25 pm Dec 17, 2013|
|How to block your 301 redirect from showing up in google.com
|5||ggman||5:35 am Dec 16, 2013|
|Problem with Google reading HTTPS Homepage
301 redirect to https homepage
|16||Rogs99||3:05 am Nov 30, 2013|
|FTP.Domain.com Ranking Higher Than www.Domain.com
Why is my FTP site ranking higher than my www.?
|5||mpeters742||5:12 pm Nov 21, 2013|
|Blocked Url's by robots.txt in google webmaster tool
how to fix it?
|20||Evan_Rachel||5:53 pm Nov 16, 2013|
|sitemap.xml for a Forum - A few questions
||4||Christa||9:41 pm Nov 11, 2013|
|Is it possible to block file names beginning with a text string?
||2||Gemini23||8:07 am Nov 11, 2013|
|Can't stop googlebot crawling specific forum
||10||persons||4:44 am Nov 10, 2013|
|wordpress and sitemaps
generating sitemap for non-wordpress pages
|1||deborahbaker||2:46 pm Oct 2, 2013|
|Is my robots.txt file ok?
||6||Bubzeebub||11:28 pm Sep 28, 2013|
|Google does not honor robots.txt
||11||newbies||3:40 pm Sep 12, 2013|
|Is 301 Redirect info stored in the cached page?
||3||flanok||4:14 pm Aug 31, 2013|
|Search Engines Displaying wrong meta-description
Wordpress login error as description on non-WP pages
|2||jamesMP||7:53 am Aug 29, 2013|
|Inadvertently used 301 redirected URL's in XML Sitemap
||1||dflayfield||7:38 pm Aug 28, 2013|
|Link rel to robots.txt
what's the link tag to pull robots.txt
|8||0verdose||1:13 pm Aug 22, 2013|
|Help needed with XML Sitemaps
||3||shaunm||7:42 am Aug 22, 2013|
|I am confused about my sitemaps. What is best to do?
||6||virtualreality||12:13 pm Jul 26, 2013|
|What to do with deleted pages?
||6||rlopes||12:04 pm Jul 26, 2013|
|Microdata - which to use for a "training course"?
It's for sale, so is it a "Product" or a "CreativeWork"?
|3||bigtoga||1:19 pm Jul 15, 2013|
|Pages with Partially Syndicated Content
No indexing of page elements
|2||jexx||4:59 pm Jun 22, 2013|
|For all sitemap lines (URLs), can you just cut out the http://domain.
||4||2kegx||5:29 pm Jun 10, 2013|