Welcome to WebmasterWorld Guest from 54.161.64.174

Forum Moderators: Ocean10000 & incrediBILL & phranque

Message Too Old, No Replies

Way of using .htaccess to only allow some bots ?

     
8:11 pm on Jan 18, 2011 (gmt 0)

10+ Year Member



Using .htaccess is there any way of only allowing the legit robots to visit please?

Any help much appreciated.

Dexie
8:17 pm on Jan 18, 2011 (gmt 0)

WebmasterWorld Senior Member g1smd is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



Yes, but you will have to define what you consider to be legit - by UA and by IP.

Armed with that information you can start to craft some rules, and latterly some code.
8:59 pm on Jan 18, 2011 (gmt 0)

10+ Year Member



Thanks g1smd - which bots would generally be considered as legit please? Google, MSN, Yahoo, any others?
10:37 pm on Jan 18, 2011 (gmt 0)

WebmasterWorld Senior Member 5+ Year Member



which bots would generally be considered as legit please?

Those you wish to allow - each webmaster has their own preferences.

There is no quick fix, you will need to study discussions in the Spider Forum:

[webmasterworld.com...]

...
7:34 am on Jan 19, 2011 (gmt 0)

10+ Year Member



Thanks, will take a look there.
 

Featured Threads

Hot Threads This Week

Hot Threads This Month