Welcome to WebmasterWorld Guest from 188.8.131.52 , register , free tools , login , search , pro membership , help , library , announcements , recent posts , open posts Become a Pro Member
been crawled? how do you know? HollyHats msg:222316 10:27 pm on Sep 26, 2002 (gmt 0) I noticed that for google, you can go to www2/3 to check to see if your in the running to be listed. Is there a similar way to check in alltheweb?
Nick_W msg:222317 10:30 pm on Sep 26, 2002 (gmt 0)
Not that I'm aware of...
heini msg:222318 10:42 pm on Sep 26, 2002 (gmt 0)
Hi Holly Fast has a completely different update process than Google. Fast may sometimes have a hiccup so that results show and disappear again, but there's no staging of an updated index before going live.
How do you know if you have been crawled? Look at your logfiles, you will see a spider identifying as coming from Fast.
HollyHats msg:222319 10:56 pm on Sep 26, 2002 (gmt 0)
Heini- Yes, that is what happened to me on 9-22. I was in the directory and then was deleted. Do you know what the reasons for "hiccups" are? Thanks for the info Rumbas msg:222320 7:37 am on Sep 27, 2002 (gmt 0)
Holly, the directory is the ODP [ dmoz.org]. If you suddenly disappear from it, an editor have probably removed your site. I highly doubt that though?
The hickups comes from dealing with so much data I suppose. We're talking over 2 billion documents here that has to be sorted.
However Fast has been somewhat unstable lately and a lot of speculation have been going on.
We recently saw a large(r)
Fast update [ webmasterworld.com], and as heini says, the update frequency is very different from Google etc.