Welcome to WebmasterWorld Guest from 54.196.214.35

Message Too Old, No Replies

Why is google crawling non-existent links?

     
5:13 pm on Nov 4, 2005 (gmt 0)

New User

10+ Year Member

joined:Sept 16, 2003
posts:38
votes: 0


crawling links of mine I havent had for over a year?
6:42 pm on Nov 5, 2005 (gmt 0)

New User

10+ Year Member

joined:Sept 16, 2003
posts:38
votes: 0


Google considers my site to have 8500 pages, but I only have 600.
10:03 pm on Nov 5, 2005 (gmt 0)

Senior Member

WebmasterWorld Senior Member g1smd is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:July 3, 2002
posts:18903
votes: 0


Hopefully they are noting the 404 or 301 status that you are feeding the bot and acting on it...

There is a Google update in full swing at the moment.

Now would be the right time to make sure that you do:
- return a status of 404 for pages that do not exist
- redirect all non-www requests to www for all pages
- check all your internal links for problems
- have a trailing / on all links that point to folders.

Use WebBug and Xenu LinkSleuth to look for problems.