homepage Welcome to WebmasterWorld Guest from 54.237.98.229
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Google / Google News Archive
Forum Library, Charter, Moderator: open

Google News Archive Forum

    
Odd listings
Using my webhost's URL
MeditationMan

10+ Year Member



 
Msg#: 14428 posted 12:09 am on Jun 18, 2003 (gmt 0)

For some searches, pages on my site aren't coming up as

[mydomain.org...]

but as

https://secure.mywebhost.net/mydomain.org/directory/login.phtml

Some pages seem to be listed twice, but in at least one case the real listing has been replaced by the listing under my webhost's URL (perhaps the real one has been seen as a duplicate. I presume that this is hurting my site, since inbound links probably aren't attributed to these "new" pages.

Anyone have any clues what I can do about this? Anyone experienced anything similar?

Googleguy? Any ideas?

 

marcs

10+ Year Member



 
Msg#: 14428 posted 3:27 am on Jun 18, 2003 (gmt 0)

You could ask your web host to add an entry to their robots.txt file for

https://secure.mywebhost.net

Have them add something like :

User-agent: *
Disallow: /mydomain.org/

That ought to prevent the secure version from getting spidered again.

mcavic

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 14428 posted 3:35 am on Jun 18, 2003 (gmt 0)

I thought that Google wasn't supposed to crawl https pages?

marcs

10+ Year Member



 
Msg#: 14428 posted 3:38 am on Jun 18, 2003 (gmt 0)

mcavic : they certainly do, I've seen them in https logs for some time.

And why not, when you think about it. As long as they can spider it, they can index it.

MeditationMan

10+ Year Member



 
Msg#: 14428 posted 12:34 pm on Jun 18, 2003 (gmt 0)

Marcs: Thanks for the advice. I'll ask my webhost to do just that.

mcavic

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 14428 posted 4:43 pm on Jun 18, 2003 (gmt 0)

And why not, when you think about it. As long as they can spider it, they can index it.

Interesting. Putting a secure page into a non-secure index seems counter-intuitive. Then again, some http sites immediately redirect to https, and I guess they do want to be indexed.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google News Archive
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved