Welcome to WebmasterWorld Guest from 54.225.58.238

Forum Moderators: Robert Charlton & aakk9999 & andy langton & goodroi

Message Too Old, No Replies

Is Google spidering URLs which appear in email?

     
2:21 pm on Sep 27, 2011 (gmt 0)

Senior Member from DE 

WebmasterWorld Senior Member 10+ Year Member

joined:Feb 20, 2003
posts:877
votes: 4


I have an alert service where users can create custom news alerts. In this process unique URLs (which contain a hash value) for verification and deletion are created.

Now I'm seeing one of these URLs "id=...&hash=" in Google's index but not in bing's or Yahoo's index. I'm not not Adsense or any other kind of advertising on the page. I'm not using Google analytics.

I'm just seeing two possibilities how Google has found that URL: either is was due to the bowser/toolbar or identifying them in the e-mail (of a Gmail account). Unfortunately the entry in the database which belongs to that id is already deleted. Therefore, I doesn't know if it was a Gmail account or not.

Has anybody else seen a similar behaviour?
6:02 pm on Sept 27, 2011 (gmt 0)

Senior Member

WebmasterWorld Senior Member tedster is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:May 26, 2000
posts:37301
votes: 0


Over the years there have been several posts suspecting this. But as you say, if someone with a toolbar installed clicks on that email URL, that could trigger the crawl, too. Seems more likely.
6:55 pm on Sept 27, 2011 (gmt 0)

Senior Member

joined:Dec 29, 2003
posts:5428
votes: 0


Toolbar could be it, I know that because of my password protected admin pages.

Gmail is a possibility too