homepage Welcome to WebmasterWorld Guest from 54.167.249.155
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / WebmasterWorld / Webmaster General
Forum Library, Charter, Moderators: phranque & physics

Webmaster General Forum

    
other people using my site
webwarper.net
mack




msg:350977
 2:41 am on Jul 29, 2001 (gmt 0)

hi there.
i just carried out a title search on google to see what pages they had indexed this month. i found this link
webwarper.net/ww.pl/www.clickforchoice.co.uk/?*
it is my site with an invite to download software to speed up the net and there is also an advert placed at the bottom of the page. i was hoping this page had been dynamicaly generated but if that was the case it shouldent have been spidered by google. legaly can i ask them to stop using this page because i spend a lot of time building the directory and these people are basicaly using my content to advertize their product. the page even contains my meta tags. what do you recomend i do???

 

JonB




msg:350978
 4:55 am on Jul 29, 2001 (gmt 0)

I think that this is dinamically generated page. I tried my site and few others and all were "Working" .And Google does spider and include dinamic pages in their database - i have seen many dinamic pages in google database.

Jon

mack




msg:350979
 5:18 am on Jul 29, 2001 (gmt 0)

the big problem i have is that my site is family friendly... their content that you can access from their site if you click through isn't.

Brett_Tabke




msg:350980
 6:33 am on Jul 29, 2001 (gmt 0)

So it is dynamically generatated at run time? eg: they are downloading the content on-the-fly from your site?

(I delinked the url)

It is a dynamic pilfering script (live scraper)

webwarper.net/ww.pl/www.altavista.com/?*

It will raid any url.

Their spider ip is 208.254.8.86

Try:
webwarper.net/ww.pl/www.webmasterworld.com/?*

ban them via an htaccess file.
deny from 208.254.8.86

mack




msg:350981
 1:44 am on Jul 30, 2001 (gmt 0)

thanks brett for the ip address i am not to usefull with ht access but i have a friend who has done similar stuff for me in the past. i will prink yake a note of what you said and ask (nicely). cheers

have a great day.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / WebmasterWorld / Webmaster General
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved