homepage Welcome to WebmasterWorld Guest from 54.166.105.24
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Google / Google News Archive
Forum Library, Charter, Moderator: open

Google News Archive Forum

    
Odd listings
Using my webhost's URL
MeditationMan




msg:194445
 12:09 am on Jun 18, 2003 (gmt 0)

For some searches, pages on my site aren't coming up as

[mydomain.org...]

but as

https://secure.mywebhost.net/mydomain.org/directory/login.phtml

Some pages seem to be listed twice, but in at least one case the real listing has been replaced by the listing under my webhost's URL (perhaps the real one has been seen as a duplicate. I presume that this is hurting my site, since inbound links probably aren't attributed to these "new" pages.

Anyone have any clues what I can do about this? Anyone experienced anything similar?

Googleguy? Any ideas?

 

marcs




msg:194446
 3:27 am on Jun 18, 2003 (gmt 0)

You could ask your web host to add an entry to their robots.txt file for

https://secure.mywebhost.net

Have them add something like :

User-agent: *
Disallow: /mydomain.org/

That ought to prevent the secure version from getting spidered again.

mcavic




msg:194447
 3:35 am on Jun 18, 2003 (gmt 0)

I thought that Google wasn't supposed to crawl https pages?

marcs




msg:194448
 3:38 am on Jun 18, 2003 (gmt 0)

mcavic : they certainly do, I've seen them in https logs for some time.

And why not, when you think about it. As long as they can spider it, they can index it.

MeditationMan




msg:194449
 12:34 pm on Jun 18, 2003 (gmt 0)

Marcs: Thanks for the advice. I'll ask my webhost to do just that.

mcavic




msg:194450
 4:43 pm on Jun 18, 2003 (gmt 0)

And why not, when you think about it. As long as they can spider it, they can index it.

Interesting. Putting a secure page into a non-secure index seems counter-intuitive. Then again, some http sites immediately redirect to https, and I guess they do want to be indexed.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google News Archive
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved