Forum Moderators: phranque
Most other search scripts i tried just search by the description the person posted with their URL submission... I dont want to keep updating the description for the URL everytime that page changes.
In summary i need a (CGI/PERL) script that spiders pages every so often. I just need it to spider about a dozen.
Ive tried the one at [xav.com...] but it only seems to spider the pages on my own host ....
Can someone pleeeeaaaassssseeeee help :)
Thanks a lot!
-G
Friendly forum you got here
Maybe you should try posting a question to the Fluid Dynamics Discussion Board [xav.com] because that search script should spider other urls.
If I'm not mistaken, that is the same search engine script that this site uses and Brett spiders this site as well as Search Engine World [searchengineworld.com] with it.
I use it myself for our site but that is the only one we ever spidered.
Perhaps its because I tried it on a free hosting site? [free.prohosting.com...]
I like their services but perhaps they dont have a certain module installed???
Who knows... Im just some 16 year old kid who needs a spidreing script to beef up his resume..... (gettin tired of McDonalds)
If anyone knows of another script or free host that supports the Fluid Dynamics script than please email or post it in this forum ;) ;) ;)
If you are doing this stuff at 16, you won't be working at McDonald's long.
Actually i jsut checked fluid dynamics website, and it said that it definetly works on hypermart (but now i have to put in a bllody credit card #)... I have a few fake ones, but im worried that they automatically charge me if i exceed the bandwidth limit...
Im assuming the spidering search script would use up a lot of bandwidth? And i did try the auto install.. Im trying it now on netfirms..
It takesa like a minute or 2.... I tried testing a spider search on google.com, and it said error:404 not found. I tried it on some other minor sites and got the same. When i had it spider netfirms.com, there was no prob bob.... According to their help it said the script will partially work on netfirms and prohosting since they ahve limited sockets installed....
--->"CGI supported, but without full sockets privileges -- FDSE search engine won't be fully functional"
So, prohosting and netfirms only spider their own server, and im too scared to try hypermart.... :(
What is a boy to do?
They seem to be requiring it in case the account goes over disk space or bandwidth allotments.
