Welcome to WebmasterWorld Guest from 54.234.45.10

Forum Moderated by: goodroi

Sitemaps, Meta Data, and robots.txt


Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
Thread SubjectMessagesStarted byLast Message
googlebot sitemap question
thinking about submitting sitemap, but not decided yet
5 cirlong 2:38 pm Jul 13, 2008
Robots.txt code sensitive to missed spaces?
6 Marketing_Guy 2:48 pm Jul 11, 2008
GoogleBot muxing URLS and I want to block it
6 webdude 2:29 pm Jul 11, 2008
How to block this URLs
3 vreelmistee 2:26 pm Jul 11, 2008
blocking certain files with robots.txt?
5 htdawg 2:26 pm Jul 11, 2008
Using Wildcat
2 stormshield 5:13 pm Jul 6, 2008
Dynamic URL's and robots.txt
4 cgydosh 3:37 pm Jul 2, 2008
How to setup robots.txt?
3 Cameron08 10:23 am Jun 27, 2008
Indexing problem for few pages in Google
I have optimized one static web site vinsystech.com.
3 venuakkala 12:49 pm Jun 24, 2008
Syntax for disallowing folder with '.' in the name?
Asking for clarification
3 ALbino 10:40 pm Jun 23, 2008
Google ignores one line of robots.txt
8 wheelie34 9:16 am Jun 22, 2008
Google under cover?
3 Guido 1:38 pm Jun 13, 2008
Need to block and remove 1 page from serps
4 StaceyJ 8:32 pm Jun 6, 2008
spiders list
3 hugh 12:49 pm Jun 6, 2008
Home page blocked accidentally by robots tag
home page dropped from serps
5 jeffe 6:19 pm May 21, 2008
robots.txt file being ignored and old content not being removed
10 Marty3454 11:46 pm May 20, 2008
To use or not to use a robots.txt file
3 con771 6:03 pm May 20, 2008
4 Wordpress File's Link To Be Blocked
How should I block them?
5 aced84 3:54 pm May 19, 2008
I think there is a problem
Robots problem
2 AllanS 10:39 am May 17, 2008
robots.txt syntax for wildcards?
3 Marfola 7:15 am May 15, 2008
How many links can i place in one page of site map?
5 bava_seo 2:12 pm May 10, 2008
why use and what is robots.txt
this maybe stupid question
3 mick_simon 4:45 pm May 7, 2008
How To stop crawler to crawl https:// pages
8 vreelmistee1 6:03 am May 7, 2008
Status: 404(not found) in Google Webmaster Tools
3 Boulder90 6:39 pm May 6, 2008
Y! and robots.txt
Partial ignore
5 Staffa 6:36 pm May 6, 2008

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members