Welcome to WebmasterWorld Guest from 54.147.10.72

Forum Moderated by: goodroi

Sitemaps, Meta Data, and robots.txt


Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
Thread SubjectMessagesStarted byLast Message
Sitemap and Robots File
If both have same entry
5 vicky 6:32 am Jan 19, 2009
Keywords in URL
The best way to write URL's to include keywords
3 calummacd 3:22 pm Jan 16, 2009
Global "no follow" and discretionary "follow"
2 dummiped 2:34 pm Jan 15, 2009
static mod rewritten URLS Vs. Physical Path in robots.txt
Robots.txt static and dynamic urls
2 frogz 9:52 am Jan 14, 2009
sitemap entry in other domain's robots.txt?
4 vicky 2:24 pm Jan 13, 2009
site maps
2 Mr_Cat 3:10 pm Jan 12, 2009
I need information on XML and Html sitemaps
I do have question regards site map
2 mick_simon 2:51 pm Jan 12, 2009
robots.txt Disallow query
Disallow specific query in Robots.txt
4 frogz 10:35 pm Jan 9, 2009
Robots.txt - Working or not ?
10 glennk 12:15 pm Jan 9, 2009
Blocking bots
6 ag_47 4:58 am Jan 8, 2009
Indexing and Crawling to Dynamic pages
Would google Crawl Dynamic CMS
3 mick_simon 2:55 am Jan 7, 2009
Disallow in Robots against guidelines?
4 cgrant 4:28 pm Jan 6, 2009
How to block this type of URL's
9 iCyborg 9:32 pm Jan 4, 2009
Having Trouble With an Allow Instruction.
Trying to adapt an example given by jdMorgan.
11 Durnovaria 1:43 pm Jan 2, 2009
If a dir is disallowed, will a sitemap in a subdir be read?
Sitemaps located in non-content directories
7 badbadmonkey 8:45 pm Jan 1, 2009
Disallow pdf
13 FiRe 11:34 am Dec 22, 2008
I want entire site indexed
7 brnm98105 8:38 pm Dec 19, 2008
blocking variables
2 fishingfriend 5:45 pm Dec 15, 2008
How to block a subdomian
Where to put the file
5 Musicarl 5:39 am Dec 15, 2008
A bit of help if possible would be appreciated.
8 glennk 7:52 pm Dec 14, 2008
Blocking Email and Print only URLS
2 himalayaswater 12:14 am Dec 7, 2008
Robots.txt - Site in a Directory
10 Sarao 10:14 pm Dec 6, 2008
nofollow noindex or disallow?
4 Gemini23 12:09 am Dec 6, 2008
Allowing Adsence bot
Googled emailed me asking to allow the adsence bot
5 alahamdan 2:02 pm Dec 5, 2008
Possible to block all urls with ? in them?
2 texasville 1:28 pm Dec 5, 2008

Featured Threads

Hot Threads This Week

Hot Threads This Month