Welcome to WebmasterWorld Guest from 220.127.116.11
Forum Moderators: open
The crawler of fast visited my site, but spidered ONLY my first page, the index.
Did I paid to have only my index spidered? They say for $35, you can have one url included. Does it means only one PAGE, or one full SITE?
In the case its only one page, whatís the point to pay? All my competitors didnít paid anything, and the spider crawled their entire site. I paid to have only ONE page spidered?
I would like to know if in site select paid subscribers ($35 for one url) will have all their site spidered or just one page, and why, after the 72hours, only one page of my site is spidered?
Well then I feel i've been totally cheated.
Why one earth would I have paid them $35 to have only one page included, when I could have the hundreds of pages of my site indexed freely (even if I had to wait more)?
As I said, my competitors have thousands of pages indexed freely (I know some of them personally and never submitted to alltheweb). Now, because I PAID, I have a lesser service than if I had not paid and i'm cursed for a year with only one page?
Alltheweb is not a directory, its a crawler. There is NO POINT having one page indexed in a crawler. I feel this is a terribly wrong practice and may ask for a refund.
as much as I would like to agree with you, unfortunately I have to say that THEY have not cheated you.
You have cheated yourself.
Its common knowledge that the price is per URL in the whole PFI scene such as Inktomi, Teoma and ATW, via all partners such as PositionTech, IneedHits etc etc.
As for the free spidering, a site search will bring lots of pros-cons of what/when/how free spidering takes place.
Would they have stated clearly that paid service (to a crawler I insist) would not crawl the site but only index ONE page I would have never subscribed.
First: ATW will very likely index your site for free, regardless if you paid for one page.
This being said, I appreciate the suggestion of Heini thank you. I will build a page with as much information possible. Do we know the ko weight limit the crawler will spider for a given page?
[edited by: koros at 11:43 pm (utc) on June 13, 2003]
Sorry, no. Never tested their limit in that regard :)
Chances are however a very long page, stuffed with information will not rank very well for any given keyword.
To give an example: I have very successfully used PFI for instant indexing of a handful of very specific product pages of a brandnew site. Slim and totally targeted selling pages. That was done to give the site a quickstart for one. Second thought was to have the chance to tweak the pages at any time depending on user reactions.
joined:Oct 23, 2000
I wouldn't pay for the index page either as it's bound to get in eventually. Remember that you pay the $35 for the first page, lesser for the following. So putting in a few additional pages will lower the average cost per url and might get you down to a resonable level.
Use pfi on your "money" pages and get them listed fast while you work on the rest of the site with the research data you get from the pfi pages. Move the pay-for-spidering round on different pages to get an idea if they're going to do good once they get the free spidering.
That way you get very good value for say a small $100 pfi project.