Spider traps...

Have i made one? eek!

[futureX]

Hey i have a small forum with around 7000 pages, which i recently opened up to googleand the other se's as the query strings were too long and i made it more friendly by changing query strings from

?s=2fa343ab3a4c145f31c18fef910c0d73&act=ST&f=5&t=567&st=60

to

/act/ST/f/5/t/567

now before, google wouldnt touch it, only the main page, since i changed it both google and inktomi have been crawling it (along with the other ones to a small extent), but...

Over the last 2 months i have had around 7000 hits from inktomi but not one page has been indexed, and i know it has been looking at different pages.

Google has only hit around 1700 times (in the last update), and according to www-sj has only indexed around 60 pages from the forums.

Surely 1700 hits is too many for 60 pages, note that this is the first update google has been able to access the forums. Have I created a spider trap? As far as i can tell there are no session ids. But from what i've gathered for every 100 bots that visit only 3 or 4 goto different pages, the rest seem to stay on the main page. I thought if i had optimised it the bots would either index or not index the links, not get stuck as it seems they do.

Or am I just being paranoid? Maybe I should wait for the real update.

[Critter]

Wait until the real update :) Google will include your pages most likely.

Ink is boneheaded...it crawled 3,500 of my pages in March and included 13...

Peter