Welcome to WebmasterWorld Guest from

Forum Moderators: open

Message Too Old, No Replies

Ask Jeeves Deep Crawling

How do you get AJ/Teoma to fully index a large site

9:51 am on Sep 21, 2005 (gmt 0)

New User

10+ Year Member

joined:Nov 8, 2004
votes: 0


I've got a large website that ranks well accross all the major engines except for Teoma/AJ, it does rank in them to a point but no where nearly as well as in the other engines.

The number of pages indexed in Teoma is only a fraction of the total number of pages on the site which is why the rankings are so poor. There are no dynamic URLs within the site, and it has a good number of backwards links (PR 6, ~35000 links ).

I'm going to try link building using Teomas Resources listings as I've been told these are sites that Teoma regards as hubs.

Has anyone else had similar experiences and come up with a solution or explanation for this patchy spidering or is it just something we have to come to terms with?



1:38 pm on Oct 4, 2005 (gmt 0)

New User

10+ Year Member

joined:May 20, 2005
votes: 0

Our experience is that AskJeeves is far more thorough, far more extensive and far more stable than any of the other search engines.

<Sorry, no personal URLs.
See Terms of Service [webmasterworld.com]>

[edited by: tedster at 1:31 pm (utc) on Oct. 9, 2005]

4:43 am on Oct 16, 2005 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Nov 20, 2004
votes: 2

The almost always have more than one spider sucking away at my site. Before I moved off my DSL for hosting I often firewalled them for periods of time just so the real users could get some access. Even now with a 10 Mb connection on a dedicated server I find it unusual not to see their spider working away.
5:23 am on Oct 16, 2005 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Nov 13, 2004
votes: 0

I bad my best luck vy simply wearing
a little bag with smashed garlic inside.

As soon as the garkicky smell weakens,
that is when to change cloves.
None of this ever proved useful against
the tougher strains of flu.

Best Wishes - Larry