Welcome to WebmasterWorld Guest from 220.127.116.11
Forum Moderators: open
Both March and April Ink got 3,000 or so pages each month.
So far this month I'm up to around 1,800 pages.
Number of pages in index (according to positiontech)...19.
This is really ridiculous: if Inktomi is going to crawl my site and eat up bandwidth then they should put those pages in its index...if not then don't frickin' crawl them.
Anyone else have this experience?
For three months straight Ink's gotten over 3,000 pages from my site each month (and is in there now), and they're taking my pages *out* of the index.
Can *anyone* shed light on this, or is Inktomi simply boneheaded?
This is a well known problem with Inktomi. Initially it will crawl all pages and show them in the index. Then it will delete the vast majority, step by step, until only two are left (can happen within a week). After that it will start adding them back again.
I have numerous sites with 30,000+ pages, they take time to remain stable in the index.
Inktomi is a roller coaster ride. First you get great results, then you fall into no-mans land. Then you climb the next hill very slowly, once at the top it doesn't kill you again!
I had domain A and domain B. Domain A was the big one. Inktomi in early August suddenly showed about 50,000 pages and I was doing well.
Then I sold domain A and transferred everything to domain B, effective on January 1. From January 1 to April 30, the new owner of domain A, as per the contract, was doing a 301 for all my deep pages from A to B. By "deep" I mean everything but the index.html home page got redirected.
Inktomi continues to crawl my domain B regularly, often several thousand pages in a single day.
During the second week in April, Inktomi dropped almost all my pages on both A and B. Only about 2000 were left on each. Traffic dropped to almost zero. Traffic has been next to zero ever since the second week in April.
As per the contract, domain A stopped redirecting on May 13 (they were two weeks late). Ever since May 13, the new owners have been showing a 404 for my pages on domain A instead of redirecting them to B.
Today I noticed that 55,000 of my pages are now showing on one of the two domains in Inktomi. Guess what -- they're showing on the domain I sold, so they're all 404. My domain B is still next to zero!
Is this a sad story, or what?