Ive used the sim_spider

[indodpendo]

And for some reason when it indexes my pages it doesnt index

[example.com...]

what it will index is.

[example.com...]
a32d92a0d263a28ea

stuff like that
how can i fix this or does it matter

[edited by: rogerd at 2:28 pm (utc) on Mar. 7, 2005]

[PatrickDeese]

It does matter, because very likely your site is assigning session IDs to the search engine spiders, and basically you are serving the same pages over and over with different URLs with the session id tacked on.

One of the ways, from what I understand, is to have your site not assign session IDs to user agents such as googlebot, slurp, etc.