Welcome to WebmasterWorld Guest from

Forum Moderators: open

Message Too Old, No Replies

If I'm crawled, am I included? I didn't pay!

If slurp visits my pages, does that mean I'll be in Inktomi's results?

1:55 am on Oct 7, 2003 (gmt 0)

New User

10+ Year Member

joined:Feb 6, 2003
votes: 0

I've seen slurp hit many of my pages on a site I've recently redesigned (new structure and content), for

lj1042.inktomisearch.com - - [19/Sep/2003:15:01:04 -0400] "GET /page-name-here.html HTTP/1.0" 200 32258 "-" "Mozilla/5.0 (Slurp/cat; slurp@inktomi.com; [inktomi.com...]

Does this mean that these pages are included in Ink's
results? Would I benefit from their paid inclusion? Would I need to pay for each page to be included, or just the root page?

I'm sure these are FAQs, but I couldn't find a FAQ or introduction, so if there's such a URL, please let me know.


2:20 am on Oct 7, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:June 29, 2000
votes: 0

WileE, just because your site gets spidered doesn't mean it's going to get included in the Ink partner serps, but it's a good sign. If it's a new site, free inclusion may not come for months, or may not come at all. If it's an existing site that has already been included in the free serps, there's a good chance new pages will show up in the serps in a few weeks.

Paying for inclusion of a page gets that page included in the serps, and none other. Paying for inclusion of one or two pages will not get the whole site spidered. Only the paid pages are guaranteed to be spidered. The rest will have to wait for "natural" processes.

12:10 pm on Oct 7, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:May 14, 2002
votes: 0


Last summer Ink realized that the lack of non-paying pages in their index made it much less useful and started their current two pronged approach: Happily take your money (and in exchange crawl you every couple of days) or automatically find pages on the web and index them for free. It seems that you have been found for free, sooner or later your pages will be in the index.

As mayor points out the pay for inclusion program works on a per page basis: you only get the pages you paid for included.

Some time ago there were several long threads about what Ink did to the rest of your site if you paid for inclusion of a few pages, some members felt that if you paid for any pages Ink would be less likely to index the rest of the site for free, as they would hope that you would pay for the other pages. I have not seen any such threads lately, and am not sure of the status of that issue.

A final point: remember that inclusion is only the first step, ranking is very important :)


Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members