Forum Moderators: open

Message Too Old, No Replies

Broken links

Will she stop crawling?

         

giggle

1:37 am on Feb 27, 2003 (gmt 0)

10+ Year Member



What happens when Google is deep crawling your site and it finds a missing link (not pre-historic skeleton!). Will it stop crawling your site or will it step back and keep trying?

yetanotheruser

1:53 am on Feb 27, 2003 (gmt 0)

10+ Year Member



giggle,

afaik she'll ignore it and keep spidering.

I was watching deepcrawl collect a lot of 301's (*) this month. She seems to add it into the back of the list and get back to it later.

Not sure if she'll try a 404 again though, until the next crawl that is.. but can't see it stopping her spidering the rest of the pages on your site..

(*) I think I mean 301? - standard re-direct for links to folders missing the trailing slash

giggle

2:23 am on Feb 27, 2003 (gmt 0)

10+ Year Member



Thanks YAU

That's a relief, this month I created hundreds of targeted pages only to find that some of the 'product' names have a / in the title which, when put into a page name, suggests that there is a sub-folder present that doesn't exist. Dozy me.