Forum Moderated by: goodroi
Using a robots.txt is all part of being a good SEO.
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Robot Help |
5 | Stra | 4:41 pm Oct 16, 2004 | ||||
| Stop image bot from indexing my images |
2 | ladyluck | 1:17 pm Oct 14, 2004 | ||||
| Quick help with robots.txt please? where to put the file? |
2 | LadyTi | 2:20 pm Oct 13, 2004 | ||||
| robots.txt to stop some domains How to allow only one domain to be indexed for the same website. |
5 | john_pinx | 3:39 am Oct 12, 2004 | ||||
| duhhhhh, dumb blonde needing help with robot.txt I don't have a clue - go easy please.... |
4 | ladyluck | 6:37 am Oct 9, 2004 | ||||
| How to Disallow a Particular Page |
5 | jsnively | 9:25 pm Oct 6, 2004 | ||||
| hacking robots.txt for RSS features? |
1 | phildog | 3:53 pm Oct 4, 2004 | ||||
| Is robots.txt always needed? robots.txt |
10 | benwalsh | 12:38 pm Oct 4, 2004 | ||||
| bad bots |
4 | rhodopsin | 11:40 am Oct 3, 2004 | ||||
| Insert disallow.php to robots is it a good idea? |
3 | sirkei | 5:52 am Oct 3, 2004 | ||||
| Can i add robot txt to a free hosting site? keywords |
2 | alze | 5:14 am Oct 3, 2004 | ||||
| Does robots.txt prevent all access? ...on page as well as directory. |
2 | yump | 5:02 am Oct 3, 2004 | ||||
| Robots.txt sabotage Common? How to protect? |
4 | adfree | 11:05 am Sep 30, 2004 | ||||
| newbie to robots.txt, want to exclude /images/ excluding some image folders but not others |
2 | franco81 | 3:29 am Sep 30, 2004 | ||||
| Newbie - Why wouldn't I want to allow certain robots? If I don't have anything on the site I want to keep private |
4 | AmyG | 4:03 pm Sep 29, 2004 | ||||
| What if your domains robots.txt Was pointed to your domain? |
5 | Daily_Sparring | 3:22 am Sep 27, 2004 | ||||
| Where to put robots in website? I has doubt where to put robots. |
3 | viva | 10:00 am Sep 26, 2004 | ||||
| robots.txt and .htaccess |
1 | HuhuFruFru | 12:02 am Sep 26, 2004 | ||||
| Excluding Sub Folders When you exclude a folder, are folders inside that excluded also? |
3 | damlag | 8:39 pm Sep 25, 2004 | ||||
| Can someone help me write a robots.txt? |
5 | budbiss | 11:50 pm Sep 19, 2004 | ||||
| www.example.com/view.php How to avoid spidering of anything with this prefix |
2 | nuevojefe | 10:26 pm Sep 19, 2004 | ||||
| robots.txt Invalid warnings |
5 | wolfline | 5:10 am Sep 17, 2004 | ||||
| possible sabotage? robot.txt working against me? |
5 | seofan | 9:36 pm Sep 8, 2004 | ||||
| who can give me a website log file sample to see? website log file |
3 | Tellist | 5:19 pm Sep 4, 2004 | ||||
| Google CHTML Proxy disobeying robots.txt Why? |
5 | yosmc | 12:16 pm Aug 31, 2004 |
