Forum Moderators: open

Message Too Old, No Replies

Fast/Lycos: submission works only for only index.htm

         

guidok

6:15 pm on Apr 16, 2002 (gmt 0)



Since 3 months I try to submit my Web-Site (every 14 days) - however, except the index. htm no side is taken up. Fast doesn't follow the links from the index.htm. What is there the matter? I also tried to submit every single page - the same result, only index.htm ist listed.

engine

7:12 pm on Apr 16, 2002 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Welcome to wmw Guidok,

You should not need to keep submitting your website - it serves no purpose.

Assuming the links from your index page are working, the spider will eventually follow them.

Another way to help ensure your site gets indexed is to look for suitable incoming links to your website. For example, from the appropriate category in ODP. These carry "value" and helps to point the spider to your website.

Finally, there is no need to submit the index page to Alltheweb, simply point the spider to the domain.

heini

8:34 pm on Apr 16, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



>submitting your website - it serves no purpose

Hmm - in theory this is right. Better said it was right. FAST spidered extensivly and if a new site had a good link to it it would be included automatically. Same as it works with Google.
As of lately however I certainly would recommend trying the free submit from time to time - it has helped sites getting spidered at least.

As to the problem of only the index page showing: You are sure the other pages are not indexed? FAST has a strong tendency to return just the index page of a site in serps, although the inner page from that site which is relevant to the query is indexed.
Makee sure to search for your urls with Alltheweb advanced search.

guidok

10:52 pm on Apr 16, 2002 (gmt 0)



yes, i'm sure the other pages are not indexed. i searched with "url.all:www.domain.com" or advanced search (search for "?", domain-Filter "only include "domain.com"). I also took a look in my logfiles, there i could see that fast wasn't spidering any other pages.

keywordbuys

11:27 pm on Apr 16, 2002 (gmt 0)

10+ Year Member



If you have links on your index.htm page FAST will eventually follow them. FAST does not always do this the first time around, but the next time it crawls it will spider anything it can find. Make sure to check your links and make sure they work.

glengara

6:45 am on Apr 19, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Same happening with my site, pages are indexed but only the index page is shown for a variety of serps.
I was wondering whether this was a PFI/free submit demarcation.

engine

5:47 pm on Apr 19, 2002 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



I think it's a case of waiting for the free option to kick in. If you can't wait, then the pay option seems best.

Importantly, the links from the home page must work otherwise the spider won't get past it at all.

>...not keep submitting your website - it serves no purpose.

To the extent of submissions all the time - I bet the inbox at alltheweb is spammed out. Quality links have got to be the best bet.

bewarne

3:04 pm on Apr 20, 2002 (gmt 0)



Do any of you who are only getting your home pages in the search engine have sites in frames or with flash home pages (without noframes or regular linkage into the site)? That will stop most search engine robots. But submitting every day is something I wouldn't dare do!

Marcia

3:54 pm on Apr 20, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I just looked at a site that's been up since around February, it's got the index page and several interior pages in the index - in fact, all the pages that aren't dynamic. Not ranking, but in there. I have no idea when it was submitted or how it was done. I'm assuming only the index page would have been submitted.

IanTurner

12:45 pm on May 2, 2002 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



I am seeing this behaviour on one of my sites so I did a little digging.

Will FAST continue to support free inclusion?
Yes. We will support free inclusion as we have in the past for single page submissions.

from

[fastsearch.com...]

It looks like fast is only going to spider your entire site if you're alredy on the list or you pay.

Marcia

12:59 pm on May 2, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



>Make sure to search for your urls with Alltheweb advanced search.

heini, I shouldn't have_to use advanced search. Not when they're paid for.

As to the problem of only the index page showing: You are sure the other pages are not indexed? FAST has a strong tendency to return just the index page of a site in serps, although the inner page from that site which is relevant to the query is indexed.

I did up a few content pages on a site and submitted one of them PAID_FOR. Well, it is NOT showing up after a week even though Lycos says it's submitted, but ONLY the homepage is showing up, which is a total Front Page mess and couldn't rank anyplace but Google because of the interior pages, and Inktomi, which indexes the pages you pay for. Obviously, FAST doesn't.

I PAID and they're only showing the homepage which is useless until it's torn apart with a complete redesign. Yes, the index page is in there, and it wasn't before. But that's not what I paid for. I'm fuming.

heini

1:34 pm on May 2, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Agreed Marcia. My comment was not aimed at PFI pages.

First of all, if FAST really has not included the url (meaning the specific page) you paid for, then - to my understanding of valid contracts - Lycos as the party you did the deal with is responsible to either correct that or refund you.

If however Fast did index that page, but buries it, then this might be bad luck in your case. But remember: this is strictly Pay-For-Inclusion. It's not pay for ranking.
If your index page shows up in serps where it really has no relevance, then it shows up because Fast "knows" about the relevant but buried page.

The way Fast handles collapsing/clustering of results definately needs improvement.

jdMorgan

4:07 am on May 3, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



You can disable site collapsing by using the "customize" link on the Fast/Alltheweb site. The default is collapsing enabled. I was surprised to find that there are six pages of customization settings buried in there.
Several of my sites (all non-profits or hobby sites) are fully-indexed by Fast - one of them is only 9 weeks old.
I suspect Fast picked them up from the ODP.

Marcia

11:32 am on May 5, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Well, the paid page showed up at Lycos Thursday (it took 8 days), and ranking, but not at alltheweb.

The original index page, unoptimized and very large in filesize, with the keywords not anyplace to be found hardly was at # 98. Thursday the new paid page was ranking fine at Lycos with the index page (not paid for) right alongside it, with a few very minor changes having been made to it.

I didn't look for a couple of days, but now they are both at alltheweb in the same exact spots as at Lycos, with the index page (unpaid) reflecting the current title and description.

Definitely not buried heini, and I consider that it was well worth the $30 ($18 membership + $12 per URL) to try it as a starting point. It's only for Lycos, which has delivered some PPC traffic to the site, and if it bears results we'll do a couple of more pages.

Added:
As a side-note, with the paid submission, while Lycos didn't do anything with any other pages on the site, they did report on how many pages were "spidered."

It's in ODP, so the site might have been picked up that way prior to when I had anything to do with it - but it was #98.

sparrow

1:02 pm on May 6, 2002 (gmt 0)

10+ Year Member



Does anyone know why a site would be dropped from "All the Web", which in turn would drop it from "Lycos"?

This happened to me yesterday.

I also noticed that what our Linked sites page Title seems to have bedcome truncated over night.... hmmmmm.