pendanticist
msg:19463 | 3:27 pm on Apr 12, 2003 (gmt 0) |
si3005.inktomisearch.com - - [12/Apr/2003:05:00:49 -0700] "GET /robots.txt HTTP/1.0" 200 220 "-" "Mozilla/5.0 (Slurp/si; slurp@inktomi.com; http//www.inktomi.com/slurp.html)"
si3007.inktomisearch.com - - [12/Apr/2003:05:03:53 -0700] "GET /robots.txt HTTP/1.0" 200 220 "-" "Mozilla/5.0 (Slurp/si; slurp@inktomi.com; http//www.inktomi.com/slurp.html)"
j3122.inktomisearch.com - - [12/Apr/2003:05:04:52 -0700] "GET /Libraries.html HTTP/1.0" 200 14424 "-" "Mozilla/5.0 (Slurp/cat; slurp@inktomi.com; http//www.inktomi.com/slurp.html)"
j3122.inktomisearch.com - - [12/Apr/2003:05:05:32 -0700] "GET /Statistics.html HTTP/1.0" 200 22657 "-" "Mozilla/5.0 (Slurp/cat; slurp@inktomi.com; http//www.inktomi.com/slurp.html)"
|
|
I can't say too much about years past, but it's been like this long enough that to me, it is normal. Pendanticist.
|
flexsez
msg:19464 | 4:50 am on Apr 13, 2003 (gmt 0) |
This deep crawl behavior seems unusual to me too. Within the past month my interior pages are showing up in MSN. Part of the problem with MSN is that they keep changing their minds on what direction they are headed. Their serps are all over the map on a day to day basis. When do the deep crawl results seem to show up in the serps?
|
pendanticist
msg:19465 | 10:23 pm on Apr 13, 2003 (gmt 0) |
>When do the deep crawl results seem to show up in the serps? I don't concern myself w/serps, ergo I don't know how to answer your question. Sorry. Pendanticist.
|
coconutz
msg:19466 | 1:43 am on Apr 14, 2003 (gmt 0) |
>>When do the deep crawl results seem to show up in the serps? Not sure when or if all of the pages crawled are added to the index, but Inktomi says the regular index is updated once every 2 weeks. How often is Ink updating now? [webmasterworld.com]
|
futureX
msg:19467 | 1:49 am on Apr 15, 2003 (gmt 0) |
i've had the same on and off for the past few weeks... At one point inktomi was sending a new spider every 20 seconds which continued for around 12 hours (9/10 times the same page)... Looks like every fortnight inktomi comes and hamers my site... Although i have yet to see the pages it has visited in the SERPs btw does anyone know a command on any of the inktomi sites that is equal to google's allinurl:?
|
|
