Forum Moderators: open

Message Too Old, No Replies

just the facts, ma'am

         

rcjordan

7:08 pm on Jun 6, 2000 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



OK, I'll be the "Tommy" (deaf, dumb, blind) in this one... It looks like SEW may be issuing a fire call on Fast, but I'm only seeing a faint blip on the monitor...though there IS a blip there, and that's new.

At first glance, INK-optimized sites look like they'll fly fairly well on Fast. Still, a few "survival" questions come to mind.

What does the algo target as spam?
How deep is the spidering?
Does Fast like third-level domains? (something.mydime.com)
Submittal frequency? X per day, or shall I just unload DumpTruck on it?

Brett_Tabke

11:56 pm on Jun 6, 2000 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



It is straight ahead old style easy indexing algo. The only twist is a very slight 'themes' usage (they limit the total number of pages they index from any .com).

Ink optimizeds don't do real well from what I can see - Alta is more appropriate. And I know you have been around long enough to remember; it *feels* like the old Infoseek of 97-98.

There really isn't much you have to do other than simple optimization. Kw's laced through headers and page.

Yes they index third level domains.

Submittal freq is a relative question since they only accept the base level domain. So have those links in order for the spider to follow off the home page. They go atleast one level deep, and I think it depends on how many pages total it finds whether it decides to go two levels deep. Here is one place where cloaking is still appropriate - how long it takes Fast to wise on that is anyones guess.

The difficult thing about Fast is detecting how many pages of yours it has in the index. Lycos is returning a number on 'links', but darned if I know where it is getting it (it is not from fast that I can detect).

Links: there does appear to be support for the "links:www.domain.com" syntax, but it doesn't appear to be accurate. Link numbers as tracked since last week tuesday are fluctuating quite a bit. It also looks like any domain with a "-" dash in it is not accurate.

The cool thing about the sheer size of Fast's database (300million pages) is that they find things others don't. One of the big things they run into, are LOG FILES. Search on some standard terms found in log files or apache index files (left as an exercise for the reader). You can find some interesting stuff. (Like cloaked pages from sew).

Which reminds me: link back to yourself on every page. If a page theif is going to steal your page and cloak it, at least get credit for the link to the root domain.

rcjordan

1:36 am on Jun 7, 2000 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



re: Alta is more appropriate

I just went and ran some spot-checks. I'm not doing too well with Fast. Not terrible, but not anywhere near as high as I've been doing recently in AV and INK --but my rank there is elevated because of themes. *sigh*

Pete

7:17 am on Jun 7, 2000 (gmt 0)

10+ Year Member



Brett wrote: "...they limit the total number of pages they index from any .com"

Currently for one of my sites - I have 3800 pages out of a total of 4500 in Fast's database.

To check I typed in the usual url:mysite.com. Am I missing something?

rcjordan

2:38 pm on Jun 7, 2000 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



re: I have 3800 pages out of a total of 4500 in Fast's database

Pete, how did you submit? One root url, or more?

Pete

3:10 pm on Jun 7, 2000 (gmt 0)

10+ Year Member



RC, make a habit of submitting more then just the root domain to check and see if there is any effect.

At the time, I was big on hallway pages. The site has loads and loads of accommodation listings. So I submitted hallway pages with links pointing to these pages as well as the main site pages themselves. I had submitted approximately 66 pages (4 a day), and then bang - fast started crawling and deep crawling. (Total sessions = 142 and hits = 7490) towards the end of Jan, beginning of Feb. Pages were indexed and all over the place for the keywords (site took up 6/7 out of the top 10)for a number of searches which was pretty worrying.

But, its now June and all the pages are still there and holding there positions which is great!

Regarding their relationship with Lycos, it would obviously be great for me if it became permanent. But, the relevancy of their results can be seriously dodgy. A client wants his site optimized for the term "weight loss". Check out the results below:

http://www.ussc.alltheweb.com/cgi-bin/search?type=all&query=weight+loss

If htey carry on producing this, they will have to kiss their partnership with Lycos goodbye!

Brett_Tabke

6:57 pm on Jun 7, 2000 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



url : domain doesn't actually work. It includes all references to your site including links. It might also contain pages with just "url" on them.

Maybe the limitation is something new? Or I'm just seeing a 'depth limitation'?

Brett_Tabke

10:48 pm on Jun 7, 2000 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Something new to add to the mix:

Now that fast is allowing full urls, has anyone noticed Fast actually going straight for that url? I can't. It has been going back to the root domain and then walking down into the site.

Pete

9:27 am on Jun 15, 2000 (gmt 0)

10+ Year Member



Brett, regarding:

- "url : domain doesn't actually work. It includes all references to your site including links. It might also contain pages with just "url" on them."

Quite right. But, I stand by the 3800 out of 4500 total. This new site has poor (in fact - shocking) link popularity. The pages listed are from the site.

and

- "Now that fast is allowing full urls, has anyone noticed Fast actually going straight for that url? I can't. It has been going back to the root domain and then walking down into the site."

Checked out the log files - Fast's webcrawler was hitting the full URL direct and then walking.

Brett_Tabke

1:53 pm on Jun 15, 2000 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Agreed, I am seeing similar now. No full crawl off the direct submits (yet), but they are going for the direct url. I'd not seen this before.

jilly

4:09 pm on Jun 15, 2000 (gmt 0)



Okay - so am I missing something? (I'm quite sure I am) Is there any way to tell if your site has been added to Fast's database other than if you get hits from them?

Brett_Tabke

2:04 am on Jun 16, 2000 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Try just searching on your url for starters and hunting through the results.

bartek

5:53 am on Jul 20, 2000 (gmt 0)

10+ Year Member




Use this url [ussc.alltheweb.com] and select "must include" "in the URL" in the word filters section.