[RESOLVED] [2005] Reading Web Page and Write to Text File

[rjbudz]

I've seen this done before, without a webcontrol (browser) which is handy because some of the pages get load errors, which will prevent automated downloads.

Here's what I'm trying to accomplish: For a series of web pages (several hundred, I think), download the source code for the page and store it onto a text file for later processing. This means I probably need to wait for the HTML source code to download prior to getting the next page.

Each web page can be uniquely numbered based on its URL. It can be in either HTML or (preferably) just the text from the page.

Isn't there a URLDownload function in .net? Can't seem to find it in the documentation or this forum. Help?

[Atheist]

the WebClient has a DownloadString method:

Dim wc As New Net.WebClient
        Dim html As String = wc.DownloadString("www.google.com")

[rjbudz]

Pretty easy when ya know the secret. Thank you. I do appreciate it.

Is there a way (since that one was answered so easily) to do it with just the page's text (without the HTML?

I feel like I'm asking for the moon now, but others may want to do this too (ok, it sounded good to me!)