homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Advertising / Affiliates
Forum Library, Charter, Moderators: eljefe3 & skibum

Affiliates Forum

some unusual idea of promotion
spam or not?

10+ Year Member

Msg#: 483 posted 5:09 pm on Jan 4, 2002 (gmt 0)

This came in my mind when checking googlebot spider "signature". It is identified as googlebot and then we can see [googlebot.com...] in the same line. This is all in 1 line of logs. Similar is with fast and some other.

Now has anyone think of this: write a spider which will crawl other sites on the net by following the links. Simmilar like any normal spider. Then you could write in the code so your spider will identify itself with some kind of AD: yourcompanyspider - visit us at yourcompany.com (or some other words).

I know that very little people actually look on stats everyday but this spider could visit thousand sites daily. Some people will look -i know i check when i see newspider in my logs.

So is this considered spam? We didnt contact them by e-mail. Is sending "an unwanted" or better "not requested" spider a "criminal act"?

Are there any technical dificulties here. Did anyone think of this kind of promotion?:)

ps: if this is the wrong forum please move my post.thanks.




WebmasterWorld Senior Member rcjordan us a WebmasterWorld Top Contributor of All Time 10+ Year Member

Msg#: 483 posted 5:21 pm on Jan 4, 2002 (gmt 0)

It's being done already and it's spam, IMO. I think it makes your site vulnerable to revenge spider/DOS attacks too.


WebmasterWorld Administrator brett_tabke us a WebmasterWorld Top Contributor of All Time 10+ Year Member

Msg#: 483 posted 5:23 pm on Jan 4, 2002 (gmt 0)

Been there - done that. Several years ago. 97 was my first running - 2000'ish my last. Currently, you'll find about 30-40 of the same thing running around on a regular basis. Most of them don't use agents, but just generate false referrers back to a site.

This falls under stealth marketing.

We have several members who have their browsers setup to generate false referrers on every page view. Some are quite creative and link to things like the click through counters at Yahoo or Direct Hit.

The problem with them, is that the results declined so far, that it got into 10k pages viewed to get one return user. When I did it the first time, it was like 500 to 1 (I thought I'd found the holy grail).


WebmasterWorld Administrator brett_tabke us a WebmasterWorld Top Contributor of All Time 10+ Year Member

Msg#: 483 posted 5:25 pm on Jan 4, 2002 (gmt 0)

Good point RC - dDOS attacks are a very huge problem when you do it.


10+ Year Member

Msg#: 483 posted 6:01 pm on Jan 4, 2002 (gmt 0)

Settin MSIE referal to something fixed would be an equivalent to Opera's no-referals mode.

Any info on how to do it would be appreciated.


10+ Year Member

Msg#: 483 posted 4:32 pm on Jan 12, 2002 (gmt 0)

I think you all missed one aspect of this type of advertising.

That simple fact is that a LOT of websites stats are spidered by the search engines... each referer you have on their stats page = a link to your website, which in turn boosts link popularity.

Spam? No, doing this uses none of the users personal bandwidth. And by recording stats for his site the user is ASKING to see referers.

William Cross


10+ Year Member

Msg#: 483 posted 10:24 am on Jan 13, 2002 (gmt 0)

Well, there really is a variable embedded here that we have to take a look at.

If the bot advertisement rotates back to an actual search engine/directory service, most people won't be angry about it.. you're just another promotional listing for their web site.

If the spider leaves behind an advertisement which points back to your "web design" business, you'll probably enjoy some dDOS attacks for your efforts.

I mean, Google has spidered my sites and I've never submitted to it.. but I really don't take offense to this happening because Google is a real search engine. Now, if Google happened to be any other type of company.. I would be pretty annoyed.

Justin Dalrymple: WebWorkz Network, Inc.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Advertising / Affiliates
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved