Welcome to WebmasterWorld Guest from 54.144.107.83

Forum Moderators: martinibuster

Message Too Old, No Replies

Yahoo Scraping Google Adwords?

     
6:39 pm on Jan 17, 2007 (gmt 0)

Junior Member

10+ Year Member

joined:June 24, 2005
posts:59
votes: 0


Is anyone else noticing that Yahoo is picking up Google Adwords links? I only know because i append all of my Google and other PPC links with a src=#*$!X and my trackign software also appends similar information.
5:20 am on Jan 19, 2007 (gmt 0)

Administrator from JP 

WebmasterWorld Administrator bill is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Oct 12, 2000
posts: 14470
votes: 49


I just noticed this as well. I hadn't checked my Yahoo SERPs in a while and just noticed that they indexed several of my AdWords pages. What's up with that?

I guess the first question would be, 'how do we get them to stop it?' Do I have to change all of my AdWords tracking codes?

3:23 pm on Jan 19, 2007 (gmt 0)

New User

5+ Year Member

joined:Nov 6, 2006
posts:2
votes: 0


I've noticed that the urls we use to advertise on Business.com have got into Yahoo’s index. i.e. www.mysite.com?source=bus.com

So far it has only been for long tail queries. I would sure like to know why this has happened.

3:44 pm on Jan 19, 2007 (gmt 0)

Preferred Member

10+ Year Member

joined:Nov 22, 2000
posts: 487
votes: 0


If this is not just some random occurrence where someone used the url on a webpage, this would mean Google was rendering and following links in JS.

Either that or the url data is getting passed to Yahoo some other way. I vote for the later.

4:45 pm on Jan 19, 2007 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Oct 9, 2004
posts:1435
votes: 0


Toolbars...

If your page is publically accessible by a browser (and has people actually visiting it) then expect the big search engines to find it evntually.

This does have worrying issues for managing a site, looks at though banning robots and other measures are required for pages we previously didn't think would end up in the SERPS.

6:41 pm on Jan 19, 2007 (gmt 0)

Preferred Member

10+ Year Member

joined:Feb 4, 2003
posts:537
votes: 0


Yes! I noticed this a couple months ago when my tracking system indicated AdWords clicks coming from Yahoo. I investigated and saw that these were from SERPS listings with the AdWords code.

At SES Chicago I asked a Yahoo rep is this would be a problem as far as duplicate content penalties. He didn't seem to understand my concern and only questioned how Yahoo would know about these URLs. I said I guessed it was the toolbar.

More recently, I asked the question on Yahoo's search blog because I am concerned about a duplicate content penalty (the URLs show up in SiteExplorer, too). No answer.

5:32 am on Jan 20, 2007 (gmt 0)

Preferred Member

10+ Year Member

joined:Mar 4, 2003
posts:421
votes: 0


Which keyword when you search that you found those adwords? I have searched several keywords, it is still Overture link.
7:22 pm on Jan 20, 2007 (gmt 0)

Junior Member

10+ Year Member

joined:June 24, 2005
posts:59
votes: 0


Just do a site: request on your domain and look for the urls that you use in Google. I can easily identify them because I append "src=google" to every keyword in my google account.
2:06 pm on Jan 21, 2007 (gmt 0)

Preferred Member

10+ Year Member

joined:Aug 16, 2003
posts:525
votes: 0


This is something I noticed back on the July 13th '06 update and it's still prevalent today. Was quite surprised to see nobody else noticed it 6 months ago! Really makes you wonder how many times you've had to pay for SPIDER clicks!

[webmasterworld.com ]

[edited by: MLHmptn at 2:08 pm (utc) on Jan. 21, 2007]

4:49 am on Feb 28, 2007 (gmt 0)

Administrator from JP 

WebmasterWorld Administrator bill is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Oct 12, 2000
posts:14470
votes: 49


The people at the Yahoo! Search Blog have addressed this specifically and provided a simple way to keep these sorts of tracking URIs out of their SERPs.

Keeping Ad Tracking and Dead URLs out of Yahoo! Search [ysearchblog.com]

If you don't want Yahoo! Slurp, our Web crawler to index these URLs you can use wildcards in robots.txt. For example, if you are using the parameter 'ref' to track ad sources, you can use a rule like the one below to keep your tracking URLs from being Slurped:

User-Agent: Yahoo! Slurp
Disallow: /*ref=YahooPublisherNetwork
10:02 pm on Feb 28, 2007 (gmt 0)

Junior Member

10+ Year Member

joined:June 24, 2005
posts:59
votes: 0


Thanks - This is exactly what I've been looking for.
5:01 am on Mar 12, 2007 (gmt 0)

Administrator from JP 

WebmasterWorld Administrator bill is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Oct 12, 2000
posts:14470
votes: 49


I just wanted to follow up and report that all of my tracking code URIs have now disappeared from Yahoo's SERPs after implementing this. My site dropped a few slots in a few cases, but that may have been due to something else.
7:52 am on Mar 13, 2007 (gmt 0)

Preferred Member

10+ Year Member

joined:Oct 19, 2004
posts:351
votes: 0


Still waiting for mine to disappear placed the entry in the bot file the same day still seeing 100’s of links that shouldn’t be there.

Vimes.

 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members