Inktomi being strange

Bot following links incorrecly?

[Richie]

I checked logs this morning and noticed there was a lot of page errors where Inktomi bot had tried to access pages that don't exist.

I use php includes so links in those go from the root like "/abc/xyz/blah.php" so if the bot is on a page in a directory called "/jql/blah2.php" and it has a link to the above page, it's trying to go to "/jql/abc/xyz/blah.php" which it's never done before.

All I've done is make a php script that inserts different meta descriptions based on the page name and add a google nosnippet meta tag.

Why might it be doing this?

[jeremy goodrich]

Hm I haven't seen any strange behavior on my sites, but those aren't php.

Have you tried running a spider simulator or similar on your site to check the links, etc? To see if something could be getting parsed badly?

[Richie]

Checked them today and noticed it isn't following links from pages so it must of saved some bad ones. Last month I added a few links so robots would follow them, thinking of the index page only so I didn't add / in front, but because it was in a php include the links displayed on all pages. Removed them now anyway.

It should stop trying to index the pages when it gets a 404 error for them?