| Altavista crawler?
Mechanics of altavista crawl process |
scottj
msg:23381 | 7:35 pm on Apr 24, 2003 (gmt 0) |
Hi,
I am beeing crawled by
buildrack38.sw.av.com Is that altavista's main crawler?
When they came a month ago I don't
remember seeing the "buildrack38.sw"
just something like xyz.av.com When does altavista update their index?
Is there a schedule at all? Thanks for any info,
=Scott
|
jeremy goodrich
msg:23382 | 7:56 pm on Apr 24, 2003 (gmt 0) |
x.yz.av.com or anything really, ending in .av.com is usually one of their spiders. Afaik, regular updates don't happen, they probably update their index as much as they care too...the db there is very small, and even with good positions, the traffic is tiny. However, if you pay Overture for the top listings there, or perhaps try the altavista XML feed, perhaps you can get more out of them...
|
|
|
