homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / WebmasterWorld / Webmaster General
Forum Library, Charter, Moderators: phranque

Webmaster General Forum

other people using my site

 2:41 am on Jul 29, 2001 (gmt 0)

hi there.
i just carried out a title search on google to see what pages they had indexed this month. i found this link
it is my site with an invite to download software to speed up the net and there is also an advert placed at the bottom of the page. i was hoping this page had been dynamicaly generated but if that was the case it shouldent have been spidered by google. legaly can i ask them to stop using this page because i spend a lot of time building the directory and these people are basicaly using my content to advertize their product. the page even contains my meta tags. what do you recomend i do???



 4:55 am on Jul 29, 2001 (gmt 0)

I think that this is dinamically generated page. I tried my site and few others and all were "Working" .And Google does spider and include dinamic pages in their database - i have seen many dinamic pages in google database.



 5:18 am on Jul 29, 2001 (gmt 0)

the big problem i have is that my site is family friendly... their content that you can access from their site if you click through isn't.


 6:33 am on Jul 29, 2001 (gmt 0)

So it is dynamically generatated at run time? eg: they are downloading the content on-the-fly from your site?

(I delinked the url)

It is a dynamic pilfering script (live scraper)


It will raid any url.

Their spider ip is


ban them via an htaccess file.
deny from


 1:44 am on Jul 30, 2001 (gmt 0)

thanks brett for the ip address i am not to usefull with ht access but i have a friend who has done similar stuff for me in the past. i will prink yake a note of what you said and ask (nicely). cheers

have a great day.

Global Options:
 top home search open messages active posts  

Home / Forums Index / WebmasterWorld / Webmaster General
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved