I paid for inclusion, but will it crawl entire site or only frontpage?

[koros]

Hello, I’m a bit worried.
I subscribed to insite select ( here [insite.lycos.com...] ) $35 to have my site spidered and included rapidly (72 hours).

The crawler of fast visited my site, but spidered ONLY my first page, the index.
Did I paid to have only my index spidered? They say for $35, you can have one url included. Does it means only one PAGE, or one full SITE?

In the case its only one page, what’s the point to pay? All my competitors didn’t paid anything, and the spider crawled their entire site. I paid to have only ONE page spidered?

I would like to know if in site select paid subscribers ($35 for one url) will have all their site spidered or just one page, and why, after the 72hours, only one page of my site is spidered?

Cordially,
Koros

[Shak]

Koros

Welcome to Webmasterworld [webmasterworld.com]

1 page only, sorry if thats not what you had in mind.

[webmasterworld.com...]

Shak

[koros]

Hello Shak,
thanks for your answer.

Well then I feel i've been totally cheated.
Why one earth would I have paid them $35 to have only one page included, when I could have the hundreds of pages of my site indexed freely (even if I had to wait more)?

As I said, my competitors have thousands of pages indexed freely (I know some of them personally and never submitted to alltheweb). Now, because I PAID, I have a lesser service than if I had not paid and i'm cursed for a year with only one page?

Alltheweb is not a directory, its a crawler. There is NO POINT having one page indexed in a crawler. I feel this is a terribly wrong practice and may ask for a refund.

Koros

[Shak]

Koros,

as much as I would like to agree with you, unfortunately I have to say that THEY have not cheated you.

You have cheated yourself.

Its common knowledge that the price is per URL in the whole PFI scene such as Inktomi, Teoma and ATW, via all partners such as PositionTech, IneedHits etc etc.

As for the free spidering, a site search will bring lots of pros-cons of what/when/how free spidering takes place.

Shak

[heini]

Koros, welcome to the board.
First: ATW will very likely index your site for free, regardless if you paid for one page.
That is assuming you have a site they feel worthwile indexing, which is mostly a question of having links to the site.
Paying for PFI does the following:
- instant access
- constant refreshing
IMO it's not a good idea to pay just to get in. It can make sense to pay for pages which are often refreshed, or for pages which might not make it in otherwise.
I would however not pay for an index page.
You might consider changing the url (you are allowed to change as oftn as you wish) to a page specially set up for this purpose, perhaps a page leading to your most important offer.

[koros]

I'm sorry Shak, but I really feel i've been sucked out $35.
It didn't even came to my mind that "one URL" meant only ONE page, considering the fact that ATW crawls entire sites for free. I thought it meant one site (like www.robert.com being ONE url/site , and www.gerard.com being another).

Would they have stated clearly that paid service (to a crawler I insist) would not crawl the site but only index ONE page I would have never subscribed.

First: ATW will very likely index your site for free, regardless if you paid for one page.

Very good news!

This being said, I appreciate the suggestion of Heini thank you. I will build a page with as much information possible. Do we know the ko weight limit the crawler will spider for a given page?

Cordially,
Koros

[edited by: koros at 11:43 pm (utc) on June 13, 2003]

[chiyo]

that's great advice heini thanks

[heini]

>ko weight limit the crawler will spider for a given page

Sorry, no. Never tested their limit in that regard :)

Chances are however a very long page, stuffed with information will not rank very well for any given keyword.

To give an example: I have very successfully used PFI for instant indexing of a handful of very specific product pages of a brandnew site. Slim and totally targeted selling pages. That was done to give the site a quickstart for one. Second thought was to have the chance to tweak the pages at any time depending on user reactions.

[koros]

Oh yes indeed. Since re-spidering is fast, could be really helpfull to play with quick adapting target page depending on the event of the moment.

Smart suggestion thanks.
Koros

[Rumbas]

A pfi page can be used to get some insight of the algo, and as heini says, it will get indexed every 48 hours, so in fact you can use that one page to tweak your other pages.

I wouldn't pay for the index page either as it's bound to get in eventually. Remember that you pay the $35 for the first page, lesser for the following. So putting in a few additional pages will lower the average cost per url and might get you down to a resonable level.

Use pfi on your "money" pages and get them listed fast while you work on the rest of the site with the research data you get from the pfi pages. Move the pay-for-spidering round on different pages to get an idea if they're going to do good once they get the free spidering.

That way you get very good value for say a small $100 pfi project.