Welcome to WebmasterWorld Guest from 54.147.0.174

Forum Moderated by: goodroi

Sitemaps, Meta Data, and robots.txt


Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
Thread SubjectMessagesStarted byLast Message
Disallow all URLs with ' '
25 danwhitehouse 3:56 pm Apr 4, 2012
Can't seem to Disallow a Directory
Disallow robots.txt robots
19 Holygamer 10:52 pm Mar 20, 2012
More than 60'000 404 error page
4 mirkko22 9:09 am Mar 14, 2012
when robots get mad
1 lucy24 7:54 pm Mar 13, 2012
Google Web Preview - images not displaying
3 Seedy 12:15 pm Mar 9, 2012
.ca site ranking above .com site in USA
Google is ranking the wrong (international) site for brand searches
4 periscopeUP 1:36 pm Mar 6, 2012
Disallow vs noindex for duplicate content
Disallow in robots.txt, or noindex in meta tag for duplicate content
6 graeme_p 9:07 am Mar 6, 2012
languages and sitemaps
where to put language specific urls in sitemaps
4 Simon_Giddings 8:32 am Feb 23, 2012
exclude bookingform that is included on pages
11 helenp 12:16 am Feb 12, 2012
Moved: Dropped from Google.
Post was moved here: http://www.webmasterworld.com/google/4425676.htm
1 System 10:04 am Feb 3, 2012
Need Help! - no data in WMT - is it robots.txt or https?
Something has happened to my search query data, I need help getting it back
3 Scarlett1985 4:00 am Feb 3, 2012
Google keywords
keywords, disallow, user, agent
8 cyberdyne 12:01 pm Jan 15, 2012
How do I stop g bot from crawling directories?
7 shazam 5:38 pm Jan 8, 2012
Page Loads Fine but returning a 404 error
Page Loads Fine but returning a 404 error
3 ronleal0 1:01 pm Jan 5, 2012
Robots text to block all but index page of a forum
8 Pjman 12:34 pm Dec 22, 2011
Microformats for when the page has no rating?
2 azn_romeo_4u 12:02 am Dec 21, 2011
HTML suggestions - Duplicate title tags report
14 Vrindavan 12:20 am Dec 20, 2011
Mobile or regular sitemap?
best practice for smartphone oriented sites
1 Mishaelo 6:59 am Dec 14, 2011
google changing link structure and then serving 404 in WMT
1 meelosh 10:07 pm Nov 23, 2011
Link checker reports some exclusion
2 toplisek 11:29 pm Nov 9, 2011
Issues with Bing Sitemap files
Bing webmaster is showing errors for files accepted in Google webmaster
7 pankajj 1:46 pm Nov 5, 2011
Duplicate Content
4 joyjesters 11:12 pm Nov 1, 2011
Mobile video sitemaps
Whats are the changes from desktop video sitemap?
6 Mishaelo 6:29 am Oct 27, 2011
Video sitemaps and CDNs
Having index and sitemap files on different domains
7 Mishaelo 9:50 am Oct 19, 2011
Sitemap for N number of pages
3 srisudha 6:10 am Oct 18, 2011

Featured Threads

Hot Threads This Week

Hot Threads This Month