| Welcome to WebmasterWorld Guest from 126.96.36.199 |
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
|Subscribe and Support WebmasterWorld|
|Way of using .htaccess to only allow some bots ?|
| 8:11 pm on Jan 18, 2011 (gmt 0)|
Using .htaccess is there any way of only allowing the legit robots to visit please?
Any help much appreciated.
| 8:17 pm on Jan 18, 2011 (gmt 0)|
Yes, but you will have to define what you consider to be legit - by UA and by IP.
Armed with that information you can start to craft some rules, and latterly some code.
| 8:59 pm on Jan 18, 2011 (gmt 0)|
Thanks g1smd - which bots would generally be considered as legit please? Google, MSN, Yahoo, any others?
| 10:37 pm on Jan 18, 2011 (gmt 0)|
|which bots would generally be considered as legit please? |
Those you wish to allow - each webmaster has their own preferences.
There is no quick fix, you will need to study discussions in the Spider Forum:
| 7:34 am on Jan 19, 2011 (gmt 0)|
Thanks, will take a look there.
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
© Webmaster World 1996-2014 all rights reserved