Welcome to WebmasterWorld Guest from

Message Too Old, No Replies

Is Google spidering URLs which appear in email?



2:21 pm on Sep 27, 2011 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

I have an alert service where users can create custom news alerts. In this process unique URLs (which contain a hash value) for verification and deletion are created.

Now I'm seeing one of these URLs "id=...&hash=" in Google's index but not in bing's or Yahoo's index. I'm not not Adsense or any other kind of advertising on the page. I'm not using Google analytics.

I'm just seeing two possibilities how Google has found that URL: either is was due to the bowser/toolbar or identifying them in the e-mail (of a Gmail account). Unfortunately the entry in the database which belongs to that id is already deleted. Therefore, I doesn't know if it was a Gmail account or not.

Has anybody else seen a similar behaviour?


6:02 pm on Sep 27, 2011 (gmt 0)

WebmasterWorld Senior Member tedster is a WebmasterWorld Top Contributor of All Time 10+ Year Member

Over the years there have been several posts suspecting this. But as you say, if someone with a toolbar installed clicks on that email URL, that could trigger the crawl, too. Seems more likely.


6:55 pm on Sep 27, 2011 (gmt 0)

Toolbar could be it, I know that because of my password protected admin pages.

Gmail is a possibility too

Featured Threads

Hot Threads This Week

Hot Threads This Month