Welcome to WebmasterWorld Guest from 54.211.86.24

Forum Moderated by: goodroi

Sitemaps, Meta Data, and robots.txt


Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
Thread SubjectMessagesStarted byLast Message
XML Sitemap for Blog
How to create it?
2 vicky 11:57 pm Feb 12, 2009
GSite Crawler
Soft Plus GsiteCrawler compile the correct format for xml
2 Gemini23 12:16 pm Feb 9, 2009
Correct way to exclude all dynamic pages under one url?
3 jackgordon 8:55 pm Feb 7, 2009
Duplicate content and NO INDEX
duplicate web content
3 Dezblanco 4:05 pm Feb 6, 2009
Did I invent these meta tags or are they official?
Odd that many sites now use these tags...
2 Ducki 10:45 am Feb 6, 2009
Wordpress sitemap widget
wordpress, widgets,seo
5 Manfred 1:49 pm Feb 4, 2009
Automatic 301 redirect generator for htaccess?
site directory changes - many files need moving
3 pgp566 3:36 pm Feb 2, 2009
Meta Keywords
How to write it?
3 vicky 12:29 pm Jan 28, 2009
Index page text not being indexed
7 millsy007 11:44 am Jan 20, 2009
Help with robots.txt
2 rbecking 12:07 am Jan 20, 2009
Sitemap and Robots File
If both have same entry
5 vicky 6:32 am Jan 19, 2009
Keywords in URL
The best way to write URL's to include keywords
3 calummacd 3:22 pm Jan 16, 2009
Global "no follow" and discretionary "follow"
2 dummiped 2:34 pm Jan 15, 2009
static mod rewritten URLS Vs. Physical Path in robots.txt
Robots.txt static and dynamic urls
2 frogz 9:52 am Jan 14, 2009
sitemap entry in other domain's robots.txt?
4 vicky 2:24 pm Jan 13, 2009
site maps
2 Mr_Cat 3:10 pm Jan 12, 2009
I need information on XML and Html sitemaps
I do have question regards site map
2 mick_simon 2:51 pm Jan 12, 2009
robots.txt Disallow query
Disallow specific query in Robots.txt
4 frogz 10:35 pm Jan 9, 2009
Robots.txt - Working or not ?
10 glennk 12:15 pm Jan 9, 2009
Blocking bots
6 ag_47 4:58 am Jan 8, 2009
Indexing and Crawling to Dynamic pages
Would google Crawl Dynamic CMS
3 mick_simon 2:55 am Jan 7, 2009
Disallow in Robots against guidelines?
4 cgrant 4:28 pm Jan 6, 2009
How to block this type of URL's
9 iCyborg 9:32 pm Jan 4, 2009
Having Trouble With an Allow Instruction.
Trying to adapt an example given by jdMorgan.
11 Durnovaria 1:43 pm Jan 2, 2009
If a dir is disallowed, will a sitemap in a subdir be read?
Sitemaps located in non-content directories
7 badbadmonkey 8:45 pm Jan 1, 2009

Featured Threads

My Threads

Hot Threads This Week

Hot Threads This Month