Welcome to WebmasterWorld Guest from 54.224.253.82

Forum Moderators: open

Message Too Old, No Replies

Insta spider

     
12:15 pm on Sep 4, 2000 (gmt 0)

Administrator from US 

WebmasterWorld Administrator brett_tabke is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 21, 1999
posts:38057
votes: 12


So, alta's insta add-url spider does not visit on all accounts? Or just resubmissions? Or is there a pattern?
9:07 pm on Sept 5, 2000 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Mar 20, 2000
posts:1702
votes: 0


I'll have to look through some logs to verify (which I haven't had time to do yet), but as far as I know they're still doing the insta spider on all submissions to check for 404's, robot.txt, etc...

What have you noticed?

2:04 pm on Sept 6, 2000 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:July 8, 2000
posts:684
votes: 0


Brett:

We're seeing instant crawling on everything we've submitted over the last week. Approx. 800 URL's per day, across 200 domains.

2:58 pm on Sept 6, 2000 (gmt 0)

Administrator from US 

WebmasterWorld Administrator brett_tabke is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 21, 1999
posts:38057
votes: 12


No I'm not seeing it visit on all submissions now (hand). I did just try some and they all had visits from:
128.177.243.86 bigip-nat.sv.alta-vista.net Scooter/1.0

But that wasn't happening on Sunday and Monday. I will keep a very close eye on it. It isn't a domain thing or anything like that - these were all new domains that were never indexed.

For those watching turn around times. Just submitted a new one from:
[searchengineworld.com]

(let me know when you find it in a search ;)

4:31 am on Sept 7, 2000 (gmt 0)

Full Member

10+ Year Member

joined:July 22, 2000
posts:329
votes: 0


Brett,

I seem to be getting hit from the following.
Host:128.177.243.86
Agent:Scooter/1.0

and I am getting listed within 4 days on these submissions.

Anybody else seeing this?