homepage Welcome to WebmasterWorld Guest from 54.225.24.227
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
domain.com vs www.domain.com
different sites
HitProf




msg:1526556
 11:38 pm on Jul 4, 2004 (gmt 0)

Hi all,

A client has a site www.domain.com. This site happens to be completely different from domain.com. Now we want to keep domain.com out of the search engines but not www.domain.com.

We probably have access to www.domain.com but most likely not to the root of domain.com to place a robots.txt there.

What other options would you suggest?
Thanks!

 

HitProf




msg:1526557
 4:33 pm on Jul 5, 2004 (gmt 0)

*bump*

anyone?

bakedjake




msg:1526558
 4:34 pm on Jul 5, 2004 (gmt 0)

<duh: Read the post, Jake>

[edited by: bakedjake at 4:35 pm (utc) on July 5, 2004]

digitalv




msg:1526559
 4:34 pm on Jul 5, 2004 (gmt 0)

I'm a little confused, first why would you want the content to be different and second why wouldn't you have access to one of the domains?

The solution would be to buy two hosting accounts ... if they're different sites, then robots.txt on domain.com isn't the same as robots.txt on www.domain.com since they are different physical files.

bakedjake




msg:1526560
 4:36 pm on Jul 5, 2004 (gmt 0)

If you can get .htaccess permission, just kill permission to domain.com via search engine IP and .htaccess.

HitProf




msg:1526561
 5:03 pm on Jul 5, 2004 (gmt 0)

> why would you want the content to be different
nothing to "want", this client is stuck with this provider

>and second why wouldn't you have access to one of the domains?
because they've put the webmail on the other domain...

There is no way out of this ISP as they've invested a ton in their proprietary system (site, shopping cart, bookkeeping and a lot of other related things included in one package) :(

>The solution would be to buy two hosting accounts ... if they're
> different sites, then robots.txt on domain.com isn't the same as
> robots.txt on www.domain.com since they are different physical files.

I hope we can simply place a robots.txt but it doesn't look like that.

> If you can get .htaccess permission
I doubt that, but we'll try.

Thanks so far. More ideas?

ZachFSW




msg:1526562
 3:37 pm on Jul 7, 2004 (gmt 0)

Um, spend six or seven bucks and buy a new domain name maybe?

HitProf




msg:1526563
 3:56 pm on Jul 7, 2004 (gmt 0)

And do what with that domain?

(not sarcastic, just looking for a clue)

rogerd




msg:1526564
 4:01 pm on Jul 7, 2004 (gmt 0)

Hitprof, while it is techically very possible to have different content at domain.com and www.domain.com, I think it could be quite confusing to visitors who may type them interchangeably. If you must go that route, I'd definitely have clear linkage so people can find what they are looking for.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved