Welcome to WebmasterWorld Guest from

Forum Moderators: open

Message Too Old, No Replies

When does Teoma update their database?



9:04 pm on Apr 9, 2003 (gmt 0)

10+ Year Member

Have been spidered in full speed today by the Ask Jeeves / Teoma robot and wonder when I might be expect some traffic from them? Do they have monthly updates like Google or do they add continuously?

BTW: I asked Jeeves but I was referred to WebmasterWorld - a good system ;) - but this forum didn't helped me further.

Anyone knowing the answers? Please post here and mail Jeeves...


1:30 pm on Apr 10, 2003 (gmt 0)

10+ Year Member

Dont know for sure but I think they did one about 3 weeks ago as hits from Jeeves shot up.

Im pretty sure they dont update every monthish like google, from my experience it seems roughly a 3 month thing.


9:17 am on Apr 15, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

Teoma as Dazz says did an update a few weeks ago.

Their crawl/update pattern is not like others. They do a partial update / crawl every few weeks, with a full system crawl every 3-5 months, though occasionally some back to back crawls (full) over a couple of months, though this was when Direct Hit technology was absorbed.

> Anyone knowing the answers? Please post here and mail Jeeves.

Don't worry about AJ, they know they're own crawl schedule, unfortunately they don't tell any of us. So that's why we observe. If you look back through the crawl update posts in this forum, you can find substantial information about the crawls, and the developments at Ask Jeeves and their search system TEOMA.


6:29 am on Apr 20, 2003 (gmt 0)

10+ Year Member

Teoma/Jeeves just ended there deep crawl a few days back on my site.

I dont know when they will update their database.


3:00 pm on Apr 23, 2003 (gmt 0)

10+ Year Member

I'm just getting crawled now by Teoma. I't sbeen a long time since I've seen their bots and, thus far, the total pages read and the rate at which they're being read is paltry in comparison to the googlebots. That said, it would appear that it's only a single machine that's visiting me...


5:05 am on May 3, 2003 (gmt 0)

10+ Year Member

seems teoma updated recently... I'm in there but I'm number one million :(

oh well, can't argue with that...


6:49 pm on May 18, 2003 (gmt 0)

10+ Year Member

How can you find out who is crawling your site.
Sorry, but I guess I'm a bit of a newbie.



8:17 pm on May 18, 2003 (gmt 0)

10+ Year Member

toprobroy, welcome to this forum!
When you have access to the server log files of your website you can find information on search engine spiders crawling your website.


10:23 pm on May 18, 2003 (gmt 0)

10+ Year Member

Yeah, I've seen the log files but they don't always make perfect sense. It would be better if I could make sense of it in some reportive or graphic form. In particular showing how often and when they visit in comparison to previous times.


3:51 pm on May 19, 2003 (gmt 0)

WebmasterWorld Senior Member trillianjedi is a WebmasterWorld Top Contributor of All Time 10+ Year Member


Try a google (or ask jeeves for that matter!) search for "web file analysis software".

If you can download the raw logs from your ISP, there is an abundance of software (some free GPL if you have linux) that will interpret the logs for you and automatically tell you about which bots have visited, give you graps and stats etc.

NetTracker are currently running a 15 day trial with theirs which is Windows based if you want to have a play with something before you decide what to buy.




10:47 pm on May 26, 2003 (gmt 0)

10+ Year Member

I would say that Teoma's database and update schedule may be changing presently (or shortly).

I've had over 180,000 pages crawled by Teoma in the last few weeks, and she hasn't stopped yet. At times she bangs away at the rate of 8 to 12 pages *per second*.



Featured Threads

Hot Threads This Week

Hot Threads This Month