Forum Moderators: DixonJones

Message Too Old, No Replies

Strange behavior with Slurp

         

joker197cinque

4:15 pm on Feb 1, 2006 (gmt 0)

10+ Year Member



Please, take a look to web logs of my server:


2006-01-30 00:03:56 68.142.250.200 - GET /index.asp 500 0 HTTP/1.0 Mozilla/5.0+(compatible;+Yahoo!+Slurp;+http://help.yahoo.com/help/us/ysearch/slurp) -

Other SE report correct 200 status.

What can I do to understand why slurp goes in error in a page that IS NOT in error?

Regards and thank you.

F.

Dijkgraaf

1:59 am on Feb 2, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Are you doing any code based on the User Agent?
If so you will have to get the page with a tool or browser where you can set the user agent to been the same as Slurp's and see what happens.

joker197cinque

4:03 pm on Feb 2, 2006 (gmt 0)

10+ Year Member



I am NOT using strange things for different user agent.

I tried to install on firefox "User Agent Switcher" extension and impersonate Slurp of Yahoo (try to navigate gmail this way) and I can browse correctly my domain.

I don't understand what's going on.

F.

Dijkgraaf

7:24 pm on Feb 2, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Well then the next thing to try is to log as much information as you can from your asp page and to see if that gives any clues as to what is going on. Put the logging right at the beginning of the code.
Maybe there is something extra or missing in the http request headers that is causing the issue.

joker197cinque

8:37 am on Feb 3, 2006 (gmt 0)

10+ Year Member




Well then the next thing to try is to log as much information as you can from your asp page and to see if that gives any clues as to what is going on. Put the logging right at the beginning of the code.
Maybe there is something extra or missing in the http request headers that is causing the issue.

You mean something like this:

if %user_agent% = "slurp..." then

' do something.Something what? :-)

end if

F.

Dijkgraaf

8:08 am on Feb 5, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Something like the example code at
[msdn.microsoft.com...]
that steps through tall the headers in the request, and then you will want to log it to somewhere e.g. a database.