Welcome to WebmasterWorld Guest from 188.8.131.52
Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.
|Thread Subject||Messages||Started by||Last Message|
|Robots.txt: Disallow everything except these pages
||7||ron_ron||3:30 pm Sep 4, 2014|
|No cache meta tags
Does it help Google get back and reindex faster?
|3||kokopoko||10:11 pm Aug 23, 2014|
|making a spider handle rel canonical
||2||cpollett||8:30 pm Aug 23, 2014|
|Should I use SEO company to build sitemap or do it myself?
||11||born2run||6:00 am Jul 24, 2014|
|sitemap priority field
||3||roshaoar||4:39 am Jun 21, 2014|
|How to disallow by specific keyword?
||5||virtualreality||7:04 am Jun 11, 2014|
|Submit url to Index in Google Webmaster Tool
||7||born2run||6:50 am Jun 11, 2014|
|Help me to fix my site sitemap
I got a problem on my site, there is a alittle bit shy because of errors.
|15||hanoiguide||4:19 am May 21, 2014|
|How to get sitelinks in Google SERPs for domain?
||2||born2run||4:12 pm Mar 11, 2014|
|Block Url's by robot.txt in google webmaster tool
||3||vickyrathore||9:00 pm Mar 10, 2014|
|Problem with robots.txt?
||11||andrewc||8:09 pm Feb 25, 2014|
|A big thanks for WMT experts on this forum!
||1||born2run||1:06 pm Feb 14, 2014|
|How to set example.com & .net in GWT?
||6||born2run||5:47 am Jan 29, 2014|
|Submitted Sitemap.xml how long till it is indexed by Google?
||18||born2run||6:29 am Jan 28, 2014|
|Robots.txt vs Noindex for Used Car Listings
Robots.txt or noindex for duplicate used vehicle listings
|1||browndawg||7:21 pm Jan 23, 2014|
|Why Xml Sitemap is preferred over HTML sitemap
||3||narenfomax||5:06 pm Jan 6, 2014|
|XML Sitemap creator for 100,000K + pages
||3||Compworld||8:35 am Jan 3, 2014|
|issue indexing xml sitemap in google webmaster tools
xml sitemaps are not being indexed since last week
|4||Olinda_Luksen||4:38 am Dec 22, 2013|
Can we give it another name
|8||bilalseo||5:25 pm Dec 17, 2013|
|How to block your 301 redirect from showing up in google.com
|5||ggman||5:35 am Dec 16, 2013|
|Problem with Google reading HTTPS Homepage
301 redirect to https homepage
|16||Rogs99||3:05 am Nov 30, 2013|
|FTP.Domain.com Ranking Higher Than www.Domain.com
Why is my FTP site ranking higher than my www.?
|5||mpeters742||5:12 pm Nov 21, 2013|
|Blocked Url's by robots.txt in google webmaster tool
how to fix it?
|20||Evan_Rachel||5:53 pm Nov 16, 2013|
|sitemap.xml for a Forum - A few questions
||4||Christa||9:41 pm Nov 11, 2013|
|Is it possible to block file names beginning with a text string?
||2||Gemini23||8:07 am Nov 11, 2013|