homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / WebmasterWorld / Webmaster General
Forum Library, Charter, Moderators: phranque

Webmaster General Forum

Spider to search for current news and tips
and using the links in a webmaster newsletter

 3:15 pm on Feb 16, 2001 (gmt 0)

The moreover.com site offers excellent current news on several different topics. Their terms and conditions restrict using the LINKS they provide, which is understandable.

From moreover.com, under terms and conditions:

Use of Links.

2.1. You acknowledge that the Service contains links, descriptions and other material
(collectively, the "Links") that are protected by copyright, trademark or other
proprietary rights of Moreover.com and third-party content providers.

2.2. You may not modify any of the Links, in whole or part. Specifically, You must
display the Links as hyperlinks to the corresponding full-text article on the site from
which the article is published via a Moreover URL. The Links will only display each
headline during the day or days such headline appears on the Publisher's Site and You
may not otherwise display such headlines on Your Site at any other time. You shall not
be entitled to frame an article from a Content Provider's Site or any part thereof within
the Your Site and You shall ensure at all times that each of the Links on Your site,
when clicked, will not open in a frame. You agree that You will at all times
conspicuously designate the Content Provider as the source of the news content.

2.3. You may not publish, transmit, transfer or sell, reproduce, distribute, display, or in
any way exploit any of the Links, in whole or in part, except as expressly permitted in
this Agreement.

Is it be possible to purchase a small scale search spider (not just a browser), to produce similar results, and then to use those links in one's own webmaster newsletter, without violating copyright, trademark or infringing on the source at the original site?

Maybe this could be done on the major search engines, if one becomes very proficient at doing searches, which I'm not well-defined searches, something I'm still learning.

Any thoughts, tips, help?



 11:00 pm on Feb 17, 2001 (gmt 0)

Welcome to WmW Ray!!

From paragraph 2.2:
>The Links will only display each headline during the day or days such headline appears on the Publisher's Site and You may not otherwise display such headlines on Your Site at any other time.

If you stick the links into a newsletter, you're going to be displaying things that are out of date. I read it as a no-no.


 11:16 pm on Feb 17, 2001 (gmt 0)

Thanks Dave. I never caught that. If the links were used from moreover.com in a newsletter, they would be dead almost immediately. That would be a loser.

My post didn't come out as clearly as I had intended. Can you recommend a spider that could search in the background and come up with current news (for example, webmaster tips)? I can do the searches via the major search engines, but I don't seem to get the results I want. I would like to search on a single day and get the freshest news, not pages that have been indexed for years.


 11:46 pm on Feb 17, 2001 (gmt 0)

What is to stop you from using news services, such as moreover and the likes, to find the links and then create your own direct link to the articles you find?

Just a thought.



 11:57 pm on Feb 17, 2001 (gmt 0)

Woz >What is to stop you

I think I understand. :-) As I read through the conditions, the LINKS moreover.com offers via their news service are only protected if one is posting them via their news service to one's site. So, it looks like an ethical solution to not sign up for moreover's service, but one can still use their website to find the links and use them accordingly.

Does that sound like a solution?


 2:15 am on Feb 18, 2001 (gmt 0)

Hello Ray,

We subscribe to one such newsletter (third party like you) that just sends us the daily links direct from a Moreover feed. So obviously you CAN do it, but probably have to pay or come to some agreement.


 3:22 am on Feb 18, 2001 (gmt 0)

>Does that sound like a solution?

You gottit!



 4:32 am on Feb 18, 2001 (gmt 0)

I use iSyndicate [affiliate.isyndicate.com] for free news links. (FYI, as a user, I'm called an affiliate but it's both a free service and doesn't provide me revenue.) An SSI call to a small Perl script loads the news wires I'm presubscribed to into a page each time the page is hit. It's simple and works well for me.

They make their money on people subscribing to services above and beyond the basic freebies and there is a good selection of freebies to pick from. Take a look.


 8:24 pm on Feb 18, 2001 (gmt 0)

Additionally, if you attempt to spider Moreover, they will eventually ban your ip.

Sorry - Access Denied
Please contact support@moreover.com for more details, quoting your IP address xyz.xyz.xyz.xyz

Global Options:
 top home search open messages active posts  

Home / Forums Index / WebmasterWorld / Webmaster General
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved