Forum Moderators: open

Message Too Old, No Replies

Can titles and maybe even meta description affect crawling?

I think I stumbled onto something

         

Clark

1:40 pm on Apr 16, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



For dynamic content, I've been seeing some urls not being entered into the index. I think it's related to Titles and maybe even meta description not changing when a different value to a variable is specified. Anyone else notice this too?

takagi

1:46 pm on Apr 16, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Google can only know the title and meta tags after it has been spidered. If these pages are not indexed, I would guess there is another problem like
1. inbound PR is too low to get all pages spidered
2. there is no way a SE can know a page exists
3. wrong variablename (better not use 'ID')
4. URL becomes way too long due to all the variables
5. duplicate content

Clark

2:04 pm on Apr 16, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



This is what I'm thinking:

>>Google can only know the title and meta tags after it has been spidered. If these pages are not indexed, I would guess there is another problem like <<

I always thought duplicate content caused a PR0 for a page not that it would be excluded from the index altogether.

>>1. inbound PR is too low to get all pages spidered<<

It's not that. Many links. PR6, PR5, PR4...tons of links...

>>2. there is no way a SE can know a page exists <<

It definitely knows it. Verified in the cache of many pages.

>>3. wrong variablename (better not use 'ID')<<

I assume you mean sessionid? There is none.

>>4. URL becomes way too long due to all the variables <<

Two variables. But I've seen many instances where two variables were accepted.

>>5. duplicate content <<

I'm talking about a membership listing.

On a 20k page, only about 2 sentences change for each member. But the Title and Description are identical for each one. That's why I thought either the Title and Description has to change or else two variables in some cases are too much?