Welcome to WebmasterWorld Guest from 3.82.52.91

Forum Moderators: LifeinAsia

Message Too Old, No Replies

search engine spider software

index content of webpages in database

     
3:44 pm on Aug 24, 2003 (gmt 0)

New User

10+ Year Member

joined:Nov 27, 2002
posts:10
votes: 0


hi guys,

i am searching a SE spider for spidering pages and dissociating html tags from the real content (head & body). as result i should get a database full of this real content. which software do you recommend for this? nedd not to be free stuff.

3:59 pm on Aug 24, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Dec 24, 2002
posts:1130
votes: 0


You might want to read:

Google like search engine .... / Making a Google like search engine .... [webmasterworld.com]

Running a search engine (and spider too) [webmasterworld.com]

why are spiders bad? [webmasterworld.com]

 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members