jatar_k
msg:3605234 | 1:38 pm on Mar 19, 2008 (gmt 0) |
there are a bunch of crawlers/spiders/bots around, you'll just have to search your search engine of choice and try them out
|
abhishekkaushik
msg:3605374 | 3:38 pm on Mar 19, 2008 (gmt 0) |
i tried finding them..but couldnt find them....i will be thankful to you if send me their names using stickymail...
|
lexipixel
msg:3605429 | 4:27 pm on Mar 19, 2008 (gmt 0) |
Take a look at Perl LWP::RobotUA The basic functionality of this class will let you create a crawler with very little code. What you do with the info it collects is another thing.
|
abhishekkaushik
msg:3606346 | 2:09 pm on Mar 20, 2008 (gmt 0) |
thanks lexi
but the problem is i am newbie to perl programming and only played with small perl programs i have downloaded the LWP class but using that class into my web pages are whole new ball game to me....
|
lexipixel
msg:3607060 | 5:04 am on Mar 21, 2008 (gmt 0) |
Your first post implied you want to build a search engine -- your last post implies you just need a search box on your own website to allow your users to search the web. What exactly are you trying to accomplish ?
|
abhishekkaushik
msg:3607122 | 8:10 am on Mar 21, 2008 (gmt 0) |
if i wasnt clear enough then let me explain once again....i wanted to create search engine which may be doing task different from generally search engine do...but search engine is not to crawl my website but to index the information from other pages that i manually enter from web I have understood my problem lately that LWP library is not installed in the web my server....are web server by default do not include these library and require personal request to install those LWP library.? Another issue is that i am working from windows workstation and having trouble installing the library i think we need to use "MAKE" command to compile and install it which are not supported by Windows...do we have something like LWP package for windows.....?
|
abhishekkaushik
msg:3607139 | 9:18 am on Mar 21, 2008 (gmt 0) |
I would like to share my recent improvement...that my web server has given me the list of perl modules which i am happy to see that complete LWP module installed to install perl on windows i have found a good link here [rcbowen.com...] which give insightfull information for unix as well as window installation..if anyone know more on this please share with me thanks
|
|
