| Welcome to WebmasterWorld Guest from 220.127.116.11 |
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
|Pubcon Platinum Sponsor 2014|
So, alta's insta add-url spider does not visit on all accounts? Or just resubmissions? Or is there a pattern?
I'll have to look through some logs to verify (which I haven't had time to do yet), but as far as I know they're still doing the insta spider on all submissions to check for 404's, robot.txt, etc...
What have you noticed?
We're seeing instant crawling on everything we've submitted over the last week. Approx. 800 URL's per day, across 200 domains.
No I'm not seeing it visit on all submissions now (hand). I did just try some and they all had visits from:
18.104.22.168 bigip-nat.sv.alta-vista.net Scooter/1.0
But that wasn't happening on Sunday and Monday. I will keep a very close eye on it. It isn't a domain thing or anything like that - these were all new domains that were never indexed.
For those watching turn around times. Just submitted a new one from:
(let me know when you find it in a search ;)
I seem to be getting hit from the following.
and I am getting listed within 4 days on these submissions.
Anybody else seeing this?
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved