homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Advertising / Paid Inclusion Engines and Topics
Forum Library, Charter, Moderator: open

Paid Inclusion Engines and Topics Forum

  posting off  
PFI / free inktomi - can you tell from the bot datails in server logs?
can you tell PFI inktomi from free inktomi from the robot request details

10+ Year Member

Msg#: 2266 posted 8:11 am on Aug 17, 2003 (gmt 0)

I have had this site up for 10 weeks, did a few PFI pages in inktomi to get MSN results. I had always seen the following IP/hostname for my PFI pages when slurp comes around to collect the pages.

HOST: j6002.inktomisearch.com

I have done something like www.SITE.com?engine=inktomi so that I can see clearly a request for a PFI page, from either slurp or a web browser.

I noticed a new IP/host for slurp, in addition to my existing pages, I see slurp requesting my index page as www.SITE.com/ - something I have never paid for. Slurp comes to pick this page up quite regularly, but at a different time to my PFI pages.

New one...

HOST: j3156.inktomisearch.com

I have seen no web browser requests with referer either msn.com or hotbot.com for the index page in the www.SITE.com/ form.

I am thinking that perhaps inktomi has picked up a link to my site and I am getting a free listing for the page, but it is not listed yet. Does anybody know if I am correct in this assumption? Does anybody do PFI and have free pages?


[edit]edited to say that the request header details and the useragent are identical[/edit]


Global Options:
 top home search open messages active posts  

Home / Forums Index / Advertising / Paid Inclusion Engines and Topics
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved