i have some <base href="blahblha"> tags, and it's ignoring those. so it's getting like 404 errors and no responses on half the links it is following from this one page. (it's a pretty long page with a lot of links).
i'm wondering why it isn't going after the normal links/pages that would be fine regardless of the base tag?
and why does it ignore the base tag?