Welcome to WebmasterWorld Guest from 3.80.85.76

Forum Moderated by: goodroi

Sitemaps, Meta Data, and robots.txt


Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
Thread SubjectMessagesStarted byLast Message
Mobile video sitemaps
Whats are the changes from desktop video sitemap?
6 Mishaelo 6:29 am Oct 27, 2011
Video sitemaps and CDNs
Having index and sitemap files on different domains
7 Mishaelo 9:50 am Oct 19, 2011
Sitemap for N number of pages
3 srisudha 6:10 am Oct 18, 2011
Allow: ?
4 mihomes 12:57 am Oct 1, 2011
Google sitemap errors
URLs redirect to other locations
2 night707 3:20 am Sep 27, 2011
Correct use of meta data keywords
Correct use of meta data keywords
7 xshadow 7:02 am Sep 11, 2011
Google indexing blocked content
6 fatpeter 5:52 pm Sep 10, 2011
Category and Tag pages in Sitemap
listing noindex pages in sitemap
2 cloud36 6:54 am Sep 9, 2011
Robots.txt for Wordpress and Vbulletin together - Help
Robots.txt for Wordpress and Vbulletin - Help
7 anticipation 11:17 pm Sep 3, 2011
Google's Search Result Display Pattern
5 webexpert2u 3:42 am Aug 31, 2011
robots.txt disallow searching reoccuring folders
6 jchristi 2:14 am Aug 30, 2011
how to disallow feed in robot.txt readable by all bots
5 bhavana 4:42 am Aug 17, 2011
Sitemap for out of stock products
2 sam222 6:43 am Aug 9, 2011
what we do for our robots
6 lucy24 2:22 am Aug 7, 2011
Question on Sitelinks
sitelinks
3 sledge81 10:26 pm Aug 2, 2011
How can I block these kinds of urls?
3 starchild 1:45 am Aug 2, 2011
sitemap for mobile versions
2 sam222 2:11 am Jul 30, 2011
Free tools for creating a sitemap
11 Fotiman 12:13 pm Jul 27, 2011
Blocking Spiders
How to block spiders from crawling your site
6 Brian0275 9:15 pm Jul 25, 2011
which part of "disallow" did you not understand?
9 lucy24 2:46 am Jul 25, 2011
www, www21, wwww, etc. Displaying Same Content & Indexed By SEs
What to do?
5 getxb 6:48 am Jul 22, 2011
How to manage this in robots.txt
disallow a folder but include one page
10 pankajj 1:36 pm Jul 21, 2011
Disallowed Googlebot-Image bot still spidering
7 cyberdyne 8:47 am Jul 9, 2011
Archive.org
for sites not crawled since 2006
8 Neil_McRae 6:04 pm Jul 1, 2011
Googlebot not respecting custom crawl rate
13 rowan194 3:38 am Jun 22, 2011