parse html response using perl

[PankajBansal]

I need to parse html response using perl. Could anyone please help

[janharders]

use HTML::TreeBuilder [search.cpan.org]

[phranque]

you could start with this to make a request and handle the response:

#!/usr/local/bin/perl

use LWP::UserAgent;
use HTTP::Request;

my $agent = LWP::UserAgent->new(env_proxy => 1,keep_alive => 1, timeout => 30);
my $url = "http://example.com/";
my $header = HTTP::Request->new(GET => $url);
my $request = HTTP::Request->new('GET', $url, $header);
my $response = $agent->request($request);

# Check the outcome of the response
if ($response->is_success){

# parse your response here

}elsif ($response->is_error){
print $response->error_as_HTML;
}

[janharders]

I believe,

my $header = HTTP::Request->new(GET => $url);

should be

my $header = HTTP::Headers->new();

copy & pasted? ;)

and, to add, the HTML in phranque's example will be available in $response->content in the block where you'll parse it.

[phranque]

yes, check that:

#!/usr/local/bin/perl

use LWP::UserAgent;
use HTTP::Request;

my $agent = LWP::UserAgent->new(env_proxy => 1,keep_alive => 1, timeout => 30);
my $url = "http://example.com/";
my $request = HTTP::Request->new('GET', $url);
my $response = $agent->request($request);

# Check the outcome of the response
if ($response->is_success){

# parse $response->content here

}elsif ($response->is_error){
print $response->error_as_HTML;
}