Forum Moderators: Robert Charlton & goodroi
But just now I tried breaking up the site: search and I see that my 404 page is indexed with one of those old counter urls...cached june 17,2005 it has my 404 page title and everything.
I used the server header checker thing and it says it is a 404 for both the 404 page and the counter url...why would a 404 page get indexed?
I didn't have 8000 members even when the "top 100" site was running so that still wouldn't account for all of the phantom pages.
Thanks for the ideas so far! I'll keep looking.
Google has been ignoring the robots meta tag.
They have my correct url, but then a trailing slash is appended and then it just adds on random directories and pages like this:
www.example.com/page.shtml/dir1/dir3/dir4/dir2/doo.shtml
Is that my server or is googlebot bouncing around like a nut?
I thought MCutts said things in the supplemental can't hurt us - but this can't be good?