Quote Originally Posted by jmcilhinney View Post
In that case, you can use a WebClient to download a file from a URL. If you provide the domain then it will download the default document, e.g. Index.htm or Default.aspx. You can then use the HTML Agility Pack to load the document into a DOM and examine it's contents from there.

http://htmlagilitypack.codeplex.com/
Awesome. Thanks for the help!