Forum Moderators: open

Message Too Old, No Replies

schibstedsokbot?

This is a new one on me!?

         

Friday

8:38 pm on Aug 3, 2005 (gmt 0)

10+ Year Member



Sorry if this has been covered but the WW search function seems to be temporarilly out of order.
:-(

This one visited the home pages of two of my clients' sites within minutes of each other. I've never heard of it, nor can I find any reference to it "Googling."

I was HOPING I'd discovered a new Fast/AllTheWeb spider.
(I get paid on a performance basis for ALL major S.E.s so their marketshare doesn't concern me). AND, even though AllTherWeb says on their home page that they draw results fom Yahoo!, that does NOT seem to be the case at all from what I've seen. SERPs are STRONG for all clients at ATW, while they're ALL dropping like flies at Yahoo!
(BTW: What's up with Yahoo! the last few months? Anyone know? They're giving me FITS! New IPs/UAs I missed?))

But I digress....
Any info on THIS spider would be much appreciated.

IP Address: 81.93.165.151

Spider name:
schibstedsokbot (compatible; mozilla/5.0; msie 5.0; fast freshcrawler 6; contact: webcrawl@schibstedsok.no

AKA:
sch-fast-crawl01.osl.basefarm.net

Netrange: 81.93.164.0 - 81.93.165.255

TIA
:-)
Friday

GaryK

3:06 pm on Aug 4, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I'm still investigating this one but according to my notes: Appears to be related to Aftenposten, a Norwegian news website. It read and appeared to respect robots.txt. It only took one page, my home page. Needs further monitoring.

[schibstedsok.no...]

wilderness

3:17 pm on Aug 4, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



WW search function seems to be temporarilly out of order.:-(

Use the search method that balam provided in Msg#10 of this thread:
[webmasterworld.com...]

Friday

5:00 pm on Aug 4, 2005 (gmt 0)

10+ Year Member



Thanks Wilderness.
I''ve bookmarked that one.

And thank you, GaryK.
Plrease keep us posted if you learn anything else about this spider. I'll do the same.

Cheers,
:-)
Friday

finoo

9:30 pm on Aug 4, 2005 (gmt 0)

10+ Year Member



Schibsted is the owner of of Kvasir(.no) and the "new" SE eniro(.no). Kvasir use results from google. My guess is that they now are making their own index..