homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Advertising / Paid Inclusion Engines and Topics
Forum Library, Charter, Moderator: open

Paid Inclusion Engines and Topics Forum

  posting off  
Insta spider

 12:15 pm on Sep 4, 2000 (gmt 0)

So, alta's insta add-url spider does not visit on all accounts? Or just resubmissions? Or is there a pattern?



 9:07 pm on Sep 5, 2000 (gmt 0)

I'll have to look through some logs to verify (which I haven't had time to do yet), but as far as I know they're still doing the insta spider on all submissions to check for 404's, robot.txt, etc...

What have you noticed?


 2:04 pm on Sep 6, 2000 (gmt 0)


We're seeing instant crawling on everything we've submitted over the last week. Approx. 800 URL's per day, across 200 domains.


 2:58 pm on Sep 6, 2000 (gmt 0)

No I'm not seeing it visit on all submissions now (hand). I did just try some and they all had visits from: bigip-nat.sv.alta-vista.net Scooter/1.0

But that wasn't happening on Sunday and Monday. I will keep a very close eye on it. It isn't a domain thing or anything like that - these were all new domains that were never indexed.

For those watching turn around times. Just submitted a new one from:

(let me know when you find it in a search ;)


 4:31 am on Sep 7, 2000 (gmt 0)


I seem to be getting hit from the following.

and I am getting listed within 4 days on these submissions.

Anybody else seeing this?

Global Options:
 top home search open messages active posts  

Home / Forums Index / Advertising / Paid Inclusion Engines and Topics
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved