homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

Is Google spidering URLs which appear in email?

WebmasterWorld Senior Member 10+ Year Member

Msg#: 4367793 posted 2:21 pm on Sep 27, 2011 (gmt 0)

I have an alert service where users can create custom news alerts. In this process unique URLs (which contain a hash value) for verification and deletion are created.

Now I'm seeing one of these URLs "id=...&hash=" in Google's index but not in bing's or Yahoo's index. I'm not not Adsense or any other kind of advertising on the page. I'm not using Google analytics.

I'm just seeing two possibilities how Google has found that URL: either is was due to the bowser/toolbar or identifying them in the e-mail (of a Gmail account). Unfortunately the entry in the database which belongs to that id is already deleted. Therefore, I doesn't know if it was a Gmail account or not.

Has anybody else seen a similar behaviour?



WebmasterWorld Senior Member tedster us a WebmasterWorld Top Contributor of All Time 10+ Year Member

Msg#: 4367793 posted 6:02 pm on Sep 27, 2011 (gmt 0)

Over the years there have been several posts suspecting this. But as you say, if someone with a toolbar installed clicks on that email URL, that could trigger the crawl, too. Seems more likely.


Msg#: 4367793 posted 6:55 pm on Sep 27, 2011 (gmt 0)

Toolbar could be it, I know that because of my password protected admin pages.

Gmail is a possibility too

Global Options:
 top home search open messages active posts  

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved