When does Teoma update their database?

[pardo]

Have been spidered in full speed today by the Ask Jeeves / Teoma robot and wonder when I might be expect some traffic from them? Do they have monthly updates like Google or do they add continuously?

BTW: I asked Jeeves but I was referred to WebmasterWorld - a good system ;) - but this forum didn't helped me further.

Anyone knowing the answers? Please post here and mail Jeeves...

[dazz]

Dont know for sure but I think they did one about 3 weeks ago as hits from Jeeves shot up.

Im pretty sure they dont update every monthish like google, from my experience it seems roughly a 3 month thing.

[caine]

Teoma as Dazz says did an update a few weeks ago.

Their crawl/update pattern is not like others. They do a partial update / crawl every few weeks, with a full system crawl every 3-5 months, though occasionally some back to back crawls (full) over a couple of months, though this was when Direct Hit technology was absorbed.

> Anyone knowing the answers? Please post here and mail Jeeves.

Don't worry about AJ, they know they're own crawl schedule, unfortunately they don't tell any of us. So that's why we observe. If you look back through the crawl update posts in this forum, you can find substantial information about the crawls, and the developments at Ask Jeeves and their search system TEOMA.

[Farrukh]

Teoma/Jeeves just ended there deep crawl a few days back on my site.

I dont know when they will update their database.

[uber_boy]

I'm just getting crawled now by Teoma. I't sbeen a long time since I've seen their bots and, thus far, the total pages read and the rate at which they're being read is paltry in comparison to the googlebots. That said, it would appear that it's only a single machine that's visiting me...

[SactoKhmer]

seems teoma updated recently... I'm in there but I'm number one million :(

oh well, can't argue with that...

[toprobroy]

How can you find out who is crawling your site.
Sorry, but I guess I'm a bit of a newbie.

Thanks

[pardo]

toprobroy, welcome to this forum!
When you have access to the server log files of your website you can find information on search engine spiders crawling your website.

[toprobroy]

Yeah, I've seen the log files but they don't always make perfect sense. It would be better if I could make sense of it in some reportive or graphic form. In particular showing how often and when they visit in comparison to previous times.

[trillianjedi]

toprobroy:-

Try a google (or ask jeeves for that matter!) search for "web file analysis software".

If you can download the raw logs from your ISP, there is an abundance of software (some free GPL if you have linux) that will interpret the logs for you and automatically tell you about which bots have visited, give you graps and stats etc.

NetTracker are currently running a 15 day trial with theirs which is Windows based if you want to have a play with something before you decide what to buy.

hth,

TJ

[Critter]

I would say that Teoma's database and update schedule may be changing presently (or shortly).

I've had over 180,000 pages crawled by Teoma in the last few weeks, and she hasn't stopped yet. At times she bangs away at the rate of 8 to 12 pages *per second*.

Peter