Welcome to WebmasterWorld Guest from 54.226.246.160

Forum Moderators: open

Message Too Old, No Replies

Odd listings

Using my webhost's URL

     

MeditationMan

12:09 am on Jun 18, 2003 (gmt 0)

10+ Year Member



For some searches, pages on my site aren't coming up as

[mydomain.org...]

but as

[secure.mywebhost.net...]

Some pages seem to be listed twice, but in at least one case the real listing has been replaced by the listing under my webhost's URL (perhaps the real one has been seen as a duplicate. I presume that this is hurting my site, since inbound links probably aren't attributed to these "new" pages.

Anyone have any clues what I can do about this? Anyone experienced anything similar?

Googleguy? Any ideas?

marcs

3:27 am on Jun 18, 2003 (gmt 0)

10+ Year Member



You could ask your web host to add an entry to their robots.txt file for

[secure.mywebhost.net...]

Have them add something like :

User-agent: *
Disallow: /mydomain.org/

That ought to prevent the secure version from getting spidered again.

mcavic

3:35 am on Jun 18, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I thought that Google wasn't supposed to crawl https pages?

marcs

3:38 am on Jun 18, 2003 (gmt 0)

10+ Year Member



mcavic : they certainly do, I've seen them in https logs for some time.

And why not, when you think about it. As long as they can spider it, they can index it.

MeditationMan

12:34 pm on Jun 18, 2003 (gmt 0)

10+ Year Member



Marcs: Thanks for the advice. I'll ask my webhost to do just that.

mcavic

4:43 pm on Jun 18, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



And why not, when you think about it. As long as they can spider it, they can index it.

Interesting. Putting a secure page into a non-secure index seems counter-intuitive. Then again, some http sites immediately redirect to https, and I guess they do want to be indexed.

 

Featured Threads

Hot Threads This Week

Hot Threads This Month