Number of pages to submit per day per search engine.

What does everyone think?

[Machiavelli]

Ideally, I should like to pool everyone's knowledge as to how many pages anyone thinks you can submit to a search engine per day. It's an oft repeated question, but one which the search engines seem to confound by putting out misleading information.

I have usually thought that you could submit 5 pages per day per search-engine - ie 150 or so pages a month, 1800 a year. However, I recently get the feeling that AV objects to that number, Inktomi badly biases free submissions, and Google ignores submissions entirely.

So what are anyone's thoughts? I'm not too interested in paid placement, unless anyone thinks that it is the best thing since Britney Spears. I'm interested in, say, the top dozen .com SEs, as well as the financially major regional ones ( .co.uk , .de &c.).

1800 submissions a year too much?

[kevine]

As a newbie in the group, I'd like to tag on to Machiavelli's question.... How do I go about submitting pages per day? I'm a new e-tailer and I've added my homepage URL to every search engine I can think of. Are you saying I can submit lots of my site's pages - just not all at once???

I'm REALLY glad I found this group (thanks David, if you're out there!), and look forward to responses on this thread....

Kevin

[eljefe3]

Some of the search engines will spider and follow all links on your site, while others will only spider the page submitted.

SE's that seem to do a good job of spidering are Google, Lycos, Slurp(Inktomi), Gulliver (Northern Light)and Fast.

SE's that don't appear to index the entire site include AV, Excite, Go (infoseek...very sporadic).
I haven't seen any problems recently with submitting 5 pages per day. To err on the side of caution, you might consider deleting the cookies from the SE's after submission before submitting more pages.

>>Are you saying I can submit lots of my site's pages - just not all at once???

Kevin, Welcome to WMW!
Correct. Some SE's will be able to follow the links from your homepage, while others will only spider what is submitted.

[cfhoney]

I've been unsubmitting pages lately(another thread) and the info I've found from Lycos leads me to believe that they do not spider the entire site. Their add-a-url page says to submit one page at a time. Is this true?
Since I will need to submit a lot of pages, how do I delete the cookies? (Please be specific. I am very new to all this.) :)

And does anyone know if paying the SE's the $199 they want to guarantee spidering in 2-4 days is worth it?

[eljefe3]

>>I've been unsubmitting pages lately(another thread) and the info I've found from Lycos leads me to believe that they do not spider the entire site. Their add-a-url page says to submit one page at a time. Is this true?
Since I will need to submit a lot of pages, how do I delete the cookies? (Please be specific. I am very new to all this.)

I can only go on what I've seen in the logs from the various sites I take care of. Lycos T-Rex seems to be doing a good job of spidering all pages over the last 3 months or so, but it shouldn't hurt to submit to them directly also(Keep in mind that they are now incorporating Fast results into their displayed results).

As far as deleting cookies go, there are various programs which will allow you to chose which cookies to accept, which to delcine, and what cookies to remove.

Try [download.cnet.com...]

for a list of ther various cookie programs which range from freeware to shareware.

>>And does anyone know if paying the SE's the $199 they want to guarantee spidering in 2-4 days is worth it?

Inktomi has a $20 program for 1 page. Looksmart has a 48 hour review for $199, and Yahoo has a $199 for all commercial applications as well as express submissions (to be reviewed within 7 days).

>>Is it worth it? It really depends on whether you site is selling a product or service. Do a little number crunching to to verify the results. Generally for the directories, the costs are justified, but make sure that your site is worthy of being accepted (unique content presented in a good manner).

[cfhoney]

eljefe3- Thanks for the link. I will look into it.