Welcome to WebmasterWorld Guest from 54.145.136.73

Forum Moderated by: goodroi

Sitemaps, Meta Data, and robots.txt


Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
Thread SubjectMessagesStarted byLast Message
Disallow pdf
13 FiRe 11:34 am Dec 22, 2008
I want entire site indexed
7 brnm98105 8:38 pm Dec 19, 2008
blocking variables
2 fishingfriend 5:45 pm Dec 15, 2008
How to block a subdomian
Where to put the file
5 Musicarl 5:39 am Dec 15, 2008
A bit of help if possible would be appreciated.
8 glennk 7:52 pm Dec 14, 2008
Blocking Email and Print only URLS
2 himalayaswater 12:14 am Dec 7, 2008
Robots.txt - Site in a Directory
10 Sarao 10:14 pm Dec 6, 2008
nofollow noindex or disallow?
4 Gemini23 12:09 am Dec 6, 2008
Allowing Adsence bot
Googled emailed me asking to allow the adsence bot
5 alahamdan 2:02 pm Dec 5, 2008
Possible to block all urls with ? in them?
2 texasville 1:28 pm Dec 5, 2008
How is correct code within robots.txt?
4 toplisek 11:07 am Nov 29, 2008
disallowing a variable
4 KevinC 10:37 pm Nov 17, 2008
Queries about Robots.txt
Importance of Robots.txt
2 Monalisa 5:24 pm Nov 17, 2008
Disallow Yahoo to block site explorer
9 minnapple 2:23 am Nov 14, 2008
Matching patterns in robots.txt
3 kiransarv 2:39 pm Nov 9, 2008
how to block ALL bots?
18 Makaveli2007 10:50 am Nov 9, 2008
Google has a new robots.txt for today only!
4 travelin_cat 8:56 pm Oct 31, 2008
Preventing a page from being indexed but wanting links to be followed
3 realmaverick 5:24 pm Oct 21, 2008
Disallow .php in root folder but allow in sub.
3 mysticalsock 5:19 pm Oct 21, 2008
robot.txt restricted but still showing !
9 member22 2:05 pm Oct 21, 2008
robot.txt blocked pages but still alive
3 member22 1:27 pm Oct 21, 2008
Disallow: /*? - is it ok ?
6 nex99 1:22 pm Oct 21, 2008
how to block indexing of root domain, but still allow sub-domain
how to block indexing of root domain, but still allow sub-domain
6 chazeo 1:20 pm Oct 21, 2008
Block directory but not lower level folder
robots.txt block directory
2 Clicknowdomains 1:04 pm Oct 21, 2008
robots.txt
2 kiransarv 1:00 pm Oct 21, 2008

Featured Threads

My Threads

Hot Threads This Week

Hot Threads This Month