Welcome to WebmasterWorld Guest from 54.205.96.97

Forum Moderated by: goodroi

Sitemaps, Meta Data, and robots.txt


Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
Thread SubjectMessagesStarted byLast Message
Robots.txt code sensitive to missed spaces?
6 Marketing_Guy 2:48 pm Jul 11, 2008
GoogleBot muxing URLS and I want to block it
6 webdude 2:29 pm Jul 11, 2008
How to block this URLs
3 vreelmistee 2:26 pm Jul 11, 2008
blocking certain files with robots.txt?
5 htdawg 2:26 pm Jul 11, 2008
Using Wildcat
2 stormshield 5:13 pm Jul 6, 2008
Dynamic URL's and robots.txt
4 cgydosh 3:37 pm Jul 2, 2008
How to setup robots.txt?
3 Cameron08 10:23 am Jun 27, 2008
Indexing problem for few pages in Google
I have optimized one static web site vinsystech.com.
3 venuakkala 12:49 pm Jun 24, 2008
Syntax for disallowing folder with '.' in the name?
Asking for clarification
3 ALbino 10:40 pm Jun 23, 2008
Google ignores one line of robots.txt
8 wheelie34 9:16 am Jun 22, 2008
Google under cover?
3 Guido 1:38 pm Jun 13, 2008
Need to block and remove 1 page from serps
4 StaceyJ 8:32 pm Jun 6, 2008
spiders list
3 hugh 12:49 pm Jun 6, 2008
Home page blocked accidentally by robots tag
home page dropped from serps
5 jeffe 6:19 pm May 21, 2008
robots.txt file being ignored and old content not being removed
10 Marty3454 11:46 pm May 20, 2008
To use or not to use a robots.txt file
3 con771 6:03 pm May 20, 2008
4 Wordpress File's Link To Be Blocked
How should I block them?
5 aced84 3:54 pm May 19, 2008
I think there is a problem
Robots problem
2 AllanS 10:39 am May 17, 2008
robots.txt syntax for wildcards?
3 Marfola 7:15 am May 15, 2008
How many links can i place in one page of site map?
5 bava_seo 2:12 pm May 10, 2008
why use and what is robots.txt
this maybe stupid question
3 mick_simon 4:45 pm May 7, 2008
How To stop crawler to crawl https:// pages
8 vreelmistee1 6:03 am May 7, 2008
Status: 404(not found) in Google Webmaster Tools
3 Boulder90 6:39 pm May 6, 2008
Y! and robots.txt
Partial ignore
5 Staffa 6:36 pm May 6, 2008
Googlebot is Not Taking Visit to my site
robots.txt is restricted googlebot to do not visit
4 bilalseo 1:54 pm May 6, 2008

Featured Threads

My Threads

Hot Threads This Week

Hot Threads This Month