homepage Welcome to WebmasterWorld Guest from 184.73.104.82
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

    
Titles and URLs from same domain mixed up in search results
pholmstr

5+ Year Member



 
Msg#: 3622179 posted 10:30 pm on Apr 8, 2008 (gmt 0)

I run the site for a large city.

We run a main portal with about a dozen sub sites all linked off the main domain, ie:

www.example.com/subportal1
www.example.com/subportal2
www.example.com/subportal3

The sub portals are all specific to agencies at my organization, such as the Mayor's web site, the Water Bureau, etc..

Now in the search results, several of the subportals are no longer showing up for direct searches, even if I use the site:www.example.com syntax. Instead other subportals are showing, but the URLs are and Titles are mixed.

Ie: if I search for "subportal1" in the search results I get:

Title of subportal2
www.example.com/subportal3

So the title and URL are actually from two different pages, and neither matches the page I am searching specifically for. The sites are each individually 100's of pages a piece and have always received good search traffic. They are not so similar to make Google think they are dups, even though navigation schemes are the same.

Any ideas? Is anyone else experiencing this problem after the last google update?

[edited by: Robert_Charlton at 10:45 pm (utc) on April 8, 2008]
[edit reason] Used example.com - it can never be owned. [/edit]

 

tedster

WebmasterWorld Senior Member tedster us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 3622179 posted 4:09 am on Apr 9, 2008 (gmt 0)

Just to clarify, if you request this:

site:www.example.com/subportal1/

...you get results from /subportal2/ and the titles are mashed up with results from /subportal3/

I must say that's an odd bug. If you've verified that your server is returning the right information to a browser, then you could load up Firefox with the UserAgentSwitcher add-on. Plug in the googlebot user agent and see if someone's been tinkering with your server, trying to return different results to googlebot and making a hash of it.

Similarly, if you do any IP based delivery, give that a health check-up

Other than that, it certainly could be buggy data at Google right now -there's more than usual it seems during this Dewey thing, whatever it is.

pholmstr

5+ Year Member



 
Msg#: 3622179 posted 4:47 pm on Apr 9, 2008 (gmt 0)

No I am sure its not anybody messing with the code / page... I control all of that. Its nothing that would be happening because of Googlebot being the user...

If I do site:www.example.com/subportal1 I don't get the home page of that portal, which is very weird because its a major page and the rest of the site comes up.

I have 80,000 pages indexed in google so why would some of the home pages of the subsites not be coming up? Or in their place other subsites coming up? Does google think the homepages are duplicates?

To re-iterate, I am searching for one thing, getting a response that's a combination of two different web pages (a title from one and URL from another.) Neither of which match the search I was doing!

tedster

WebmasterWorld Senior Member tedster us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 3622179 posted 4:54 pm on Apr 9, 2008 (gmt 0)

So these are regular searches, not site: operator results - correct?

If so, it does sound like an issue with Google's current results. There's been a lot of disappearing and reappearing home pages in recent weeks. Maybe that problem extends to directory index pages, too.

pholmstr

5+ Year Member



 
Msg#: 3622179 posted 6:31 pm on Apr 9, 2008 (gmt 0)

Yes just regular searches, for instance if I search for our mayor, I get our neighborhood web site.

If I do "show all results from" I see lots of pages from the mayor's website in the results, but not the homepage, and the first result is always the homepage from a different sub site.

It seems to be pretty consistent in always picking the neighborhood subsite. I am going to put a block for that in our robots.txt and see if by excluding it everything will go back to normal. Then I can add it back in. Not sure if that will work but I am desperate.

g1smd

WebmasterWorld Senior Member g1smd us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 3622179 posted 10:18 pm on Apr 9, 2008 (gmt 0)

I am seeing odd stuff going on at the moment. A search like:

site:domain.com "some text to find"

is also returning several pages that are NOT from domain.com in the results.

The change has happened in the last 24 to 36 hours, or less.

Clickmonster

5+ Year Member



 
Msg#: 3622179 posted 2:38 am on Apr 10, 2008 (gmt 0)

>is also returning several pages that are NOT from domain.com in the results.

doesn't that sound familiar? Like from before 302s were "fixed"?

pholmstr

5+ Year Member



 
Msg#: 3622179 posted 3:48 pm on Apr 10, 2008 (gmt 0)

Just an update - the robots.txt attempt didn't fix anything.

This is really brutal, I'd almost rather Google not be returning results in these cases then returning the wrong results.

tedster

WebmasterWorld Senior Member tedster us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 3622179 posted 8:55 pm on Apr 10, 2008 (gmt 0)

the robots.txt attempt didn't fix anything.

If you just changed your robots.txt yesterday, then it's way too soon to know if it helped or not.

g1smd

WebmasterWorld Senior Member g1smd us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 3622179 posted 1:30 am on Apr 12, 2008 (gmt 0)

If I am putting new content up that I don't want to be indexed, I make sure that the disallow is placed in the robots.txt file at least two weeks before the content is posted.

pholmstr

5+ Year Member



 
Msg#: 3622179 posted 10:48 pm on Apr 25, 2008 (gmt 0)

Hey all this is still happening. To re-iterate again: The wrong sub folders are coming up even when I specifically search for the titles. Also the title of the page that comes up in the SERPs does not match the URL in the SERP.

[edited by: tedster at 11:31 pm (utc) on April 25, 2008]

pholmstr

5+ Year Member



 
Msg#: 3622179 posted 8:20 pm on May 21, 2008 (gmt 0)

Hey I still am having this problem a month later... I took some advice of Tedster. I also reduced the number of 301's I am using overall.

Google is still insisting on forwarding all SERPs to one of my subsites, even when that page contains none of the keywords in my search.

Really mystified here, before this problem things have not changed for 3-4 years.

pholmstr

5+ Year Member



 
Msg#: 3622179 posted 8:05 pm on Jun 6, 2008 (gmt 0)

Still having issue, going to try undoing a couple more 301's... maybe Google is punishing me for having 301's for Googlebot but not for users? I just do this in a couple cases to reduce the number of duplicate entries.

ie

example.com/blah/index.html
example.com/blah/index.html?page=23434

both redirect to:

example.com/blah/

which is the same page

tedster

WebmasterWorld Senior Member tedster us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 3622179 posted 8:32 pm on Jun 6, 2008 (gmt 0)

pholmstr, why don't other user agents get the same 301 redirect? That seems to be the safest thing to do.

g1smd

WebmasterWorld Senior Member g1smd us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 3622179 posted 8:36 pm on Jun 6, 2008 (gmt 0)

Users and bots should not hit a redirect if they follow a link from within your own site.

pholmstr

5+ Year Member



 
Msg#: 3622179 posted 9:05 pm on Jun 6, 2008 (gmt 0)

Our CMS is structured in such a way that it doesn't know the difference between /index.html and index.html?page=23434, if page 23434 is the home page.

I know its not best practice for SEO but its just how it happens to work.

So I had the 301s setup to reduce duplication of URLs, and to try to ensure the URL kept was the simple clean one.

I got rid of those 301s, so maybe Google will stop punishing us for them (if that's what's happening.)

g1smd

WebmasterWorld Senior Member g1smd us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 3622179 posted 11:34 pm on Jun 6, 2008 (gmt 0)

You are now exposing Duplicate Content. That's killer too.

The CMS needs a redesign from the ground up.

Receptional Andy



 
Msg#: 3622179 posted 12:15 am on Jun 7, 2008 (gmt 0)

Users and bots should not hit a redirect if they follow a link from within your own site.

In an ideal world, yes. The reality is that most significant websites have internal redirects. Their presence alone is not enough to cause a problem.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved