Welcome to WebmasterWorld Guest from 54.226.147.190

Forum Moderated by: goodroi

Sitemaps, Meta Data, and robots.txt


Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
Thread SubjectMessagesStarted byLast Message
robots and nav bars
excluding links in nav bars ...
2 f00fighter 11:38 pm Oct 29, 2004
Need assistance with robot controls
need help with a robot .txt file
2 borkboing 11:31 pm Oct 29, 2004
Robots.txt not working
bots not obeying robots.txt
4 cyberjunkie 11:05 pm Oct 29, 2004
Use .htaccess to serve correct robots.txt?
Using htaccess and robots.txt to elimiate file duplication and 404 errors
2 iceman 12:05 am Oct 26, 2004
Robots detection tool?
2 obsos 1:17 am Oct 25, 2004
robots.txt vs index,follow
Who will win?
3 brakkar 6:13 pm Oct 24, 2004
Removed 'deny all' robots.txt but no change
2 kapow 11:03 pm Oct 23, 2004
What name does msn's spider use?
Lots of visits from yahoo and google....but not msn
2 David_Bruning 7:05 am Oct 19, 2004
Robots.txt? (removing a specific subdirectory from google index...)
3 hugo_guzman 8:06 pm Oct 18, 2004
More help in robots.txt
robots.txt
2 sakuramy 1:25 pm Oct 18, 2004
robots.txt validator
Error, Error, Error loads of them
7 hatap 12:45 pm Oct 18, 2004
Allowing some bots, disallowing all others
2 xbase234 5:16 pm Oct 16, 2004
Robot Help
5 Stra 4:41 pm Oct 16, 2004
Stop image bot from indexing my images
2 ladyluck 1:17 pm Oct 14, 2004
Quick help with robots.txt please?
where to put the file?
2 LadyTi 2:20 pm Oct 13, 2004
robots.txt to stop some domains
How to allow only one domain to be indexed for the same website.
5 john_pinx 3:39 am Oct 12, 2004
duhhhhh, dumb blonde needing help with robot.txt
I don't have a clue - go easy please....
4 ladyluck 6:37 am Oct 9, 2004
How to Disallow a Particular Page
5 jsnively 9:25 pm Oct 6, 2004
hacking robots.txt for RSS features?
1 phildog 3:53 pm Oct 4, 2004
Is robots.txt always needed?
robots.txt
10 benwalsh 12:38 pm Oct 4, 2004
bad bots
4 rhodopsin 11:40 am Oct 3, 2004
Insert disallow.php to robots
is it a good idea?
3 sirkei 5:52 am Oct 3, 2004
Can i add robot txt to a free hosting site? keywords
2 alze 5:14 am Oct 3, 2004
Does robots.txt prevent all access?
...on page as well as directory.
2 yump 5:02 am Oct 3, 2004
Robots.txt sabotage
Common? How to protect?
4 adfree 11:05 am Sep 30, 2004

Featured Threads

Hot Threads This Week

Hot Threads This Month