Forum Moderators: DixonJones

Message Too Old, No Replies

RewriteCond Fetch API Request failed?

why this is not stopping Fetch API Request?

         

silverbytes

11:43 pm on Sep 26, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I've a httacess with this line:

But I see that spider in my logs and others too...
RewriteCond %{HTTP_USER_AGENT} ^Fetch\ API\ Request [OR]

This line is not stopping Microsoft URL Control either:

RewriteCond %{HTTP_USER_AGENT} ^Microsoft.(Data¦URL) [NC,OR]


Why is not working?

wkitty42

12:51 am on Sep 27, 2003 (gmt 0)

10+ Year Member



in both cases, the conditions are starting with a ^ (caret) which means that that text must be the first part of the UA string... if this is not so, then remove the ^ from those two conditions...

can you post the actual UA strings as they appear in your logs?

pendanticist

1:10 am on Sep 27, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Be very sure to check the site you are making the corrections to, immediately after uploading. That way you'll be on top of any 500 error codes you might initiate while tweeking your .htaccess file.

Pendanticist.

claus

1:24 am on Sep 27, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



>> is not working?

It might be working nicely. Look out for the server codes in your log files, it's always three numbers like 2xx, 3xx, 4xx, or 5xx.

If you've banned those two they will still be found in your log files, as "there is no way you can keep them from coming to your house, but you can refuse to open the door" - in this case, a shut door will look like this:

403

The number of lines containing the 403 are the number of times they have been knocking without getting in ;)

/claus

jdMorgan

2:01 am on Sep 27, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Fetch API Request can be end-anchored, but shouldn't be start-anchored:

RewriteCond %{HTTP_USER_AGENT} Fetch\ API\ Request$ [NC,OR]

However,
RewriteCond %{HTTP_USER_AGENT} ^Microsoft.(DataĻURL) [NC,OR]
should work as-is.

So, I think claus is right - check the server response codes.

Jim

silverbytes

12:31 am on Sep 28, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Ok I will have to post the entire httaccess...
Sorry it's pretty long but it's important this time...

claus

2:59 am on Sep 28, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



>> post the entire httaccess...

no, there's no need for that... just post two lines from your log file, one for each of these two: Fetch Api and Microsoft ;)