Forum Moderators: open

Message Too Old, No Replies

How to extract PR with a spider to a file

to build a db of sites sortable by PR to find advertisers

         

neuron

8:31 pm on Jun 10, 2004 (gmt 0)

10+ Year Member



I have a client I would like to build a database for of sites that sell advertising and incorporate PR as one of the fields.

The purpose of doing this is so that I could then do cost-benefit analysis comparisons so that he might get the most for his dollar investment.

The way I see it working is much like the ARELIS spider. It would go out and collect site information based on keyword searches and along with the other contact data and such also return PR info.

I can then sort to all PR8 sites and compare them, and then all PR7 sites and compare them.

My programmer (says a lot of things I don't always understand) says the google toolbar has it's own google api license and that I can't just build this into another app. At the same time, when browsing, I can hold my mouse over the PR bar and get alt numerical text of the PR score, so I know this info is freely available with just a browser and a toolbar installed. Am I left with doing this manually, do I have to hack the toolbar, or will google give me an api license to do this?

Thanks in advance.

moltar

8:42 pm on Jun 10, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



There is an algo for figuring out PR hidden within the toolbar. A very advanced programmer can get it out with a disassembler, but it's a difficult task. Also it would be against google TOS. If they catch you they can sue you and ban you from using their servers entirely.

neuron

9:12 pm on Jun 10, 2004 (gmt 0)

10+ Year Member



That penalty is a little too much like getting kicked off the Earth for me. I think I'll stay where I'm at.

I think I'll just add a field in my current db and have all my peeps install the toolbar and just enter that info manually.

No sense in pissing God, um, I mean Google off.

mars9820

11:16 am on Jun 11, 2004 (gmt 0)

10+ Year Member



there are some websites out there that allow you to search using google.com and display PR next to the results.

I just sticky you the URL.

However you cannot sort based on PR.

neuron

5:12 pm on Jun 11, 2004 (gmt 0)

10+ Year Member



Thanks, I should be able to simply show these to my programmer and have him figure it out how to do this in our own custom application. We just want to dump the results in a db and can sort them for PR later.

Thanks a million.