Forum Moderators: open

Message Too Old, No Replies

Yahoo Slurp and my site logs

Slurp visiting my site and I have questions

         

mastervisa

9:47 pm on Jan 12, 2005 (gmt 0)

10+ Year Member



I posted a longer version of this in the Logging forum, no takers there. My site is penalized on Y! Only my index page as it is listed in the Y directory comes up when doing a search. I looked at my logs and slurp comes around 3 or 4 times a day.
Slurp looks for robots.txt of course, then I found these entries which I shortened:

"GET / HTTP/1.0" 304 - "-" "Mozilla/5.0 (compatible; Yahoo! Slurp;

"GET /?variegator=6 HTTP/1.0" 200 20953 "-" "Mozilla/5.0

then the same type lines with variegator=1
variegator=9
variegator=2
variegator=11
variegator=10 and so on 4,3, you name it

on 12-31-04 slurp looked for robots.txt as usual but the next line was this:

"GET /myDMOZpage.html HTTP/1.0" 200 19178 "-" "Mozilla/5.0 (compatible; Yahoo! Slurp;

I changed the name of the page for TOS. It is my page listed in the DMOZ directory.

What is 304 in the first entry?
What is variegator? anyone else seen this?
Slurp looked for a page! But is this only because it is on DMOZ and after finding it, it ignored it?

Thanks for any input! Trying to save my site and learning more than I should!

mastervisa

5:51 pm on Jan 20, 2005 (gmt 0)

10+ Year Member



Thanks to Marino in another thread I found this about 304.
"If the client has performed a conditional GET request and access is allowed, but the document has not been modified, the server SHOULD respond with this status code 304"

I update the page every couple of days with new info or links. It has been modified.

Anyone else seeing that variegator thing I see in my logs? Or that can answer my other questions. Thanks in advance.