homepage Welcome to WebmasterWorld Guest from 54.237.98.229
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Advertising / Paid Inclusion Engines and Topics
Forum Library, Charter, Moderator: open

Paid Inclusion Engines and Topics Forum

This 37 message thread spans 2 pages: 37 ( [1] 2 > >   posting off  
Slurp out on full crawl?
Brett_Tabke

WebmasterWorld Administrator brett_tabke us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 1895 posted 2:01 pm on Jan 13, 2003 (gmt 0)

Every site I've looked at this morning has been spidered hard by Inktomi the last few hours.

Is this the start of the first big Yahoo db build?

 

creative craig

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 1895 posted 2:04 pm on Jan 13, 2003 (gmt 0)

I am seeing this to on a few of my sites.

Craig

lazerzubb

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 1895 posted 2:05 pm on Jan 13, 2003 (gmt 0)

saw it to

Tor

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 1895 posted 2:26 pm on Jan 13, 2003 (gmt 0)

I see it here in Norway also.

why_nigel

10+ Year Member



 
Msg#: 1895 posted 2:54 pm on Jan 13, 2003 (gmt 0)

I haven't seen this on my sites yet but maybe it just hasn't gotten to them yet. Probably will soon.

lawman

WebmasterWorld Administrator lawman us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 1895 posted 2:57 pm on Jan 13, 2003 (gmt 0)

They've hit both of my sites. Sorta keeps you on pins and needles about any potential change to Y! results.

lawman

ritch_b

10+ Year Member



 
Msg#: 1895 posted 2:59 pm on Jan 13, 2003 (gmt 0)

And here - just to add my voice to the crowd.

R.

edit_g

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 1895 posted 3:00 pm on Jan 13, 2003 (gmt 0)

Same here. It's like a "did you see the UFO over London the other day?" post. ;)

troels nybo nielsen

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 1895 posted 3:03 pm on Jan 13, 2003 (gmt 0)

Yep, slurp has certainly increased its activities here too. Isn't this what we've all expected to see?

stcrim

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 1895 posted 3:11 pm on Jan 13, 2003 (gmt 0)

Same Here

-s-

rick whittington

10+ Year Member



 
Msg#: 1895 posted 3:27 pm on Jan 13, 2003 (gmt 0)

What's the IP address of this bot?

glengara

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 1895 posted 3:30 pm on Jan 13, 2003 (gmt 0)

I've got this one inktomi4-not.server.ntl.com
but it's a few days old.....

zeus

WebmasterWorld Senior Member zeus us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 1895 posted 4:26 pm on Jan 13, 2003 (gmt 0)

I got a notice a few days ago that I could not see which site has been crawled, but I don think they have spidered any more then the index page, but then spider the whole web now.

zeus

Orange_XL

10+ Year Member



 
Msg#: 1895 posted 4:28 pm on Jan 13, 2003 (gmt 0)

Haven't seen them yet. How do the spider anyway? Do they start at low IP-addresses and then go up?

RussellC

10+ Year Member



 
Msg#: 1895 posted 5:04 pm on Jan 13, 2003 (gmt 0)

Slurp came and got my main site yesterday. Crawled the deepest it has in the past couple of months.

HenryUK

10+ Year Member



 
Msg#: 1895 posted 5:55 pm on Jan 13, 2003 (gmt 0)

Substantial slurp traffic over the weekend. By far the biggest since 7/8 December.
Got individual pages listed for the first time two days before that...

mayor

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 1895 posted 6:42 pm on Jan 13, 2003 (gmt 0)

Anyone seeing slup spider the unpaid pages on a site that has some PFI pages on it?

RussellC

10+ Year Member



 
Msg#: 1895 posted 8:20 pm on Jan 13, 2003 (gmt 0)

mayor, Yes.

johnser

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 1895 posted 8:50 pm on Jan 13, 2003 (gmt 0)

When are we likely to see a refresh of the database?
Any clues?
J

FrenchGuy

10+ Year Member



 
Msg#: 1895 posted 9:10 pm on Jan 13, 2003 (gmt 0)

Same here. I have PFI but now they are spidering the whole site, including pages for which I donīt PFI... and they spider all the stuff under another domain as the one on PFI...

Namaste

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 1895 posted 9:11 pm on Jan 13, 2003 (gmt 0)

whopee...how does that Inktomi algo go? :)

troels nybo nielsen

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 1895 posted 9:25 pm on Jan 13, 2003 (gmt 0)

Methinks we are a few on this board who are gonna try and learn about inking. ;)

alex_cross

10+ Year Member



 
Msg#: 1895 posted 10:27 pm on Jan 13, 2003 (gmt 0)

Where can I submit to Inktomi?

peterdaly

10+ Year Member



 
Msg#: 1895 posted 11:55 pm on Jan 13, 2003 (gmt 0)

Inktomi has requested 3070 pages on my main site this month.

It seems to have been crawling me since sometime in December almost constantly. Very slow going compared with googlebot, which "slurped" ;) over 50,000 pages in the January crawl, stopping on the 11th.

-Pete

korkus2000

WebmasterWorld Senior Member korkus2000 us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 1895 posted 11:58 pm on Jan 13, 2003 (gmt 0)
Ink submit
http://www.hotbot.lycos.co.uk/submit.html
mayor

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 1895 posted 12:12 am on Jan 14, 2003 (gmt 0)

Whoohooo ... can't get my logs until around 3AM. U betcha I'll have a fresh pot of coffee ready.

Robert Charlton

WebmasterWorld Administrator robert_charlton us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 1895 posted 12:15 am on Jan 14, 2003 (gmt 0)

korkus - I tried the hotbot.lycos.co.uk submission form a few days ago. It now submits to Fast, not Inktomi.

For Inktomi submit, this still works:

[submitit.bcentral.com...]

To be considered for inclusion in the Inktomi Search Index, powering the MSN Web Pages section

Note also, though, on the MSN site:

...only one url allowed per site allowed per day.

They really seem to keep track.

powerstar

10+ Year Member



 
Msg#: 1895 posted 3:48 am on Jan 14, 2003 (gmt 0)

You guys think we will see free traffic from Inktomi after Yahoo paid 235M or so....I am not that sure....

Yahoo wants Inktomi PFI or even better PPC.

Get ready to pay in order to play.

turk182

10+ Year Member



 
Msg#: 1895 posted 12:06 pm on Jan 14, 2003 (gmt 0)

1300 pages crawled out a total of 2500 in our site requested from December, 1st.

Seems that Inktomi crawls at a very low pace, 15 pages/hour in the "fast moments" ;) and 1 in the low.

esset2002

10+ Year Member



 
Msg#: 1895 posted 4:00 pm on Jan 14, 2003 (gmt 0)

As I wrote in another post I also saw a big increase in traffic from Ink the biggest I ever seen. It was some new domains which had got in for free. 5 days later (sunday) the domains were nowere to be found on Ink. Maybe they are doing this to sell more inclusion...You know show webmasters how much traffic you could get from MSN and etc then turn it off...

/esset

This 37 message thread spans 2 pages: 37 ( [1] 2 > >
Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Advertising / Paid Inclusion Engines and Topics
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved