MikeNoLastName - 10:54 pm on Feb 22, 2004 (gmt 0)
Wow Walkman, I totally missed that link. I wonder if that is new since so many people were having problems? Do you happen to have one which works as well for INK?!
I wrote to my submission service, Lycos, via their Insite contact e-mail and after about the 3rd e-mail THEY wrote me back and referred it to FAST. The e-mail I got back from FAST the same day was from a support technician's personal mailbox who said he was working on integrating overture/FAST/Yahoo and sincerely had no idea how it got blocked other than that it had something to do with the merging of the databases.
Outland88, In our case we were free indexed in alltheweb, quite nicely, in fact the ranking in our keywords was very nearly that in Google where we were in the top 10-20. But we were NOT on Lycos at all. I didn't realize at the time that alltheweb was using FAST exclusively. So I submitted to FAST THROUGH Lycos, figuring if they STILL did not index us, like Inktomi, I could at least complain direct to the source as a paying customer. (Unlike Intomi where you can only talk to their Lordships directly if you're spending more than $10K/ month - it says so right on their support page) Well when we DID get "indexed" according to the submission status page, we did not come up AT ALL, under any URL on Lycos. Lycos has a short page that describes how to confirm that your web page is included by typing: "url.all:http://www.yourdomain.com". When we did that a couple weeks after being submitted nothing still came up. Furthermore, three days after submitting, ALL our previous free listings disappeared from alltheweb, never returning. That's when I wrote to Lycos, sent them a copy of the confirming search I had done, and asking for a refund, and things started getting done.
We however still appear to be banned on Ink, but their strategy is much more underhanded and sneakier making it near impossible to complain. Instead of just blocking you altogether, they still include you but make it so that you can't be found by any feasible means. That way they can, like in our case, just send you a dismissing form letter that says "ha! we never said WHERE you would be indexed!" "You're an idiot novice and must be mistaken. Read our entire help section again about improving your rank." "SEE there you are, what do you mean penalty? There's no such thing." I still have the e-mails.
To determine if this is the case, first try searching for your exact page URL to see if you're in the database. Then if so, see if there are any other pages from your site. In our case there are NONE! Then, search for a long unique sentence (with lots of uncommon words) from near the top of your page in quotes. If you happen to come up alone (unlikely if you've been blocked), try something shorter until at least a dozen other results appear. Then if you are at the VERY bottom of the list below others missing half the words or obviously far from that exact sentence, it's very likely you've received some penalty. Try it again with a different sentence. Try to find yourself under your top keywords where you appear near the top on ALL the other search engines. You'll frequently see ALL the other sites which normally come up around you on the other search engines like alltheweb and google, in about the same order, but YOU'LL be the only one missing from anywhere within a few thousand positions of that rank. That's when you're pretty sure your blocked.
Does anybody know the history and relationship between FAST/Inktomi as companies? It seems they have very similar indexes, but with slightly different algo. Did they start together and then diverge, or use the same spiders or draw from the same common index? Are they really just the same company trying to double-dip PFI?