Forum Moderators: open

Message Too Old, No Replies

Deep Crawl

How deep will ink crawl?

         

Sathish

12:25 pm on Dec 26, 2002 (gmt 0)

10+ Year Member



Using Direct Submit if I add one url eg: www.myname.com, will inktomi crawl only www.myname.com/index.htm or all the pages linked from index.htm (of the same domain) will also get crawled.

jimh009

2:33 pm on Dec 26, 2002 (gmt 0)

10+ Year Member



Eventually - and I do mean eventually - it will deep crawl your entire site. Inktomi is now finally crawling my site after many months of just grabbing the home page. Its grabbing pages at all depth levels in my directory structure. Just don't expect instant crawling!

Brad

2:44 pm on Dec 26, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Ink will crawl deep but on it's own schedule. It probably will not happpen fast but they do eventually dig in.

Sathish

5:30 pm on Dec 26, 2002 (gmt 0)

10+ Year Member



Thanks jimh009,Brad.

doc

4:26 am on Dec 29, 2002 (gmt 0)

10+ Year Member



I have paid for 3 submissions to Ink and only those 3 show up. The rest of my site has never been crawled as far as I know and it has been a year since the paid inclusions.
Sometime back and somewhere, not necessarily here, I read that if you pay for inclusion in Ink then only the pages you pay for will show. However, if you get in for free, then your site will get spidered. Can anyone confirm or deny this as it is time for me to renew. Also, is there sill a way of getting in for free, Goo? Thanks.

Mohamed_E

4:32 am on Dec 29, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



> Also, is there sill a way of getting in for free, Goo? Thanks.

I got in for free, as did many others, when Ink started deep crawling the web in, as I recall, last August. I did nothing, they just followed the links that led them to my site.

Hope this helps!

coconutz

8:34 am on Dec 29, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Can anyone confirm or deny this as it is time for me to renew

Our site got dropped from Ink when the PFI expired in Sept., and was back in 2 days later. It's still in. Someone else noted that their page got dropped when they didn't renew.

  • Inktomi Renewal [webmasterworld.com]
  •