homepage Welcome to WebmasterWorld Guest from 54.242.126.9
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Code, Content, and Presentation / Perl Server Side CGI Scripting
Forum Library, Charter, Moderators: coopster & jatar k & phranque

Perl Server Side CGI Scripting Forum

    
looking for search engine script
abhishekkaushik

5+ Year Member



 
Msg#: 3605189 posted 12:37 pm on Mar 19, 2008 (gmt 0)

Hi all

i wanted to have a search engine to crawl other websites in www, i heard that perl is better suited to do this as this has good text manupulation tools, CGI and it is bit faster as well....now my question is can i get any perl coded script from anywhere

thanks

 

jatar_k

WebmasterWorld Administrator jatar_k us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 3605189 posted 1:38 pm on Mar 19, 2008 (gmt 0)

there are a bunch of crawlers/spiders/bots around, you'll just have to search your search engine of choice and try them out

abhishekkaushik

5+ Year Member



 
Msg#: 3605189 posted 3:38 pm on Mar 19, 2008 (gmt 0)

i tried finding them..but couldnt find them....i will be thankful to you if send me their names using stickymail...

lexipixel

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 3605189 posted 4:27 pm on Mar 19, 2008 (gmt 0)

Take a look at Perl LWP::RobotUA

The basic functionality of this class will let you create a crawler with very little code.

What you do with the info it collects is another thing.

abhishekkaushik

5+ Year Member



 
Msg#: 3605189 posted 2:09 pm on Mar 20, 2008 (gmt 0)

thanks lexi
but the problem is i am newbie to perl programming and only played with small perl programs i have downloaded the LWP class but using that class into my web pages are whole new ball game to me....

lexipixel

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 3605189 posted 5:04 am on Mar 21, 2008 (gmt 0)

Your first post implied you want to build a search engine -- your last post implies you just need a search box on your own website to allow your users to search the web.

What exactly are you trying to accomplish ?

abhishekkaushik

5+ Year Member



 
Msg#: 3605189 posted 8:10 am on Mar 21, 2008 (gmt 0)

if i wasnt clear enough then let me explain once again....i wanted to create search engine which may be doing task different from generally search engine do...but search engine is not to crawl my website but to index the information from other pages that i manually enter from web

I have understood my problem lately that LWP library is not installed in the web my server....are web server by default do not include these library and require personal request to install those LWP library.?

Another issue is that i am working from windows workstation and having trouble installing the library i think we need to use "MAKE" command to compile and install it which are not supported by Windows...do we have something like LWP package for windows.....?

abhishekkaushik

5+ Year Member



 
Msg#: 3605189 posted 9:18 am on Mar 21, 2008 (gmt 0)

I would like to share my recent improvement...that my web server has given me the list of perl modules which i am happy to see that complete LWP module installed

to install perl on windows i have found a good link here

[rcbowen.com...]

which give insightfull information for unix as well as window installation..if anyone know more on this please share with me

thanks

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Code, Content, and Presentation / Perl Server Side CGI Scripting
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved