Welcome to WebmasterWorld Guest from 54.161.149.107

Forum Moderated by: goodroi

Sitemaps, Meta Data, and robots.txt


Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
Thread SubjectMessagesStarted byLast Message
How do I stop g bot from crawling directories?
7 shazam 5:38 pm Jan 8, 2012
Page Loads Fine but returning a 404 error
Page Loads Fine but returning a 404 error
3 ronleal0 1:01 pm Jan 5, 2012
Robots text to block all but index page of a forum
8 Pjman 12:34 pm Dec 22, 2011
Microformats for when the page has no rating?
2 azn_romeo_4u 12:02 am Dec 21, 2011
HTML suggestions - Duplicate title tags report
14 Vrindavan 12:20 am Dec 20, 2011
Mobile or regular sitemap?
best practice for smartphone oriented sites
1 Mishaelo 6:59 am Dec 14, 2011
google changing link structure and then serving 404 in WMT
1 meelosh 10:07 pm Nov 23, 2011
Link checker reports some exclusion
2 toplisek 11:29 pm Nov 9, 2011
Issues with Bing Sitemap files
Bing webmaster is showing errors for files accepted in Google webmaster
7 pankajj 1:46 pm Nov 5, 2011
Duplicate Content
4 joyjesters 11:12 pm Nov 1, 2011
Mobile video sitemaps
Whats are the changes from desktop video sitemap?
6 Mishaelo 6:29 am Oct 27, 2011
Video sitemaps and CDNs
Having index and sitemap files on different domains
7 Mishaelo 9:50 am Oct 19, 2011
Sitemap for N number of pages
3 srisudha 6:10 am Oct 18, 2011
Allow: ?
4 mihomes 12:57 am Oct 1, 2011
Google sitemap errors
URLs redirect to other locations
2 night707 3:20 am Sep 27, 2011
Correct use of meta data keywords
Correct use of meta data keywords
7 xshadow 7:02 am Sep 11, 2011
Google indexing blocked content
6 fatpeter 5:52 pm Sep 10, 2011
Category and Tag pages in Sitemap
listing noindex pages in sitemap
2 cloud36 6:54 am Sep 9, 2011
Robots.txt for Wordpress and Vbulletin together - Help
Robots.txt for Wordpress and Vbulletin - Help
7 anticipation 11:17 pm Sep 3, 2011
Google's Search Result Display Pattern
5 webexpert2u 3:42 am Aug 31, 2011
robots.txt disallow searching reoccuring folders
6 jchristi 2:14 am Aug 30, 2011
how to disallow feed in robot.txt readable by all bots
5 bhavana 4:42 am Aug 17, 2011
Sitemap for out of stock products
2 sam222 6:43 am Aug 9, 2011
what we do for our robots
6 lucy24 2:22 am Aug 7, 2011
Question on Sitelinks
sitelinks
3 sledge81 10:26 pm Aug 2, 2011

Featured Threads

Hot Threads This Week

Hot Threads This Month