Forum Moderators: open

Message Too Old, No Replies

Writing a Spider

Need to write a spider for an online directory

         

woop01

3:17 pm on May 23, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I’ve been tasked with writing an archiver for a set of pages within an online directory. Is there a command in ASP.NET to save the source code of a web page to a string so that it can be inserted into a database.

I have the database setup and can do that part just fine. I just need help downloading the HTML source from our directory member websites.

Thanks,

aspdaddy

4:15 pm on May 23, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Screen Scrapes in ASP.NET [4guysfromrolla.com]