I have been using VB (vba actually) for a while to download pages from the web for parsing...now I am trying to integrate the scripts into a super duper VB program to do the same, and trying to get everything right. I have used both IExplorer (i think that is the class--the one that wraps with WebBrowser) and MSXML2.ServerXMLHTTP to do this. I know there are a couple other technologies out there to do the same...

So my question is, what is the quickest (as in shortest time from .navigate or its equivalent) to getting the page into a buffer. My other question is, what object gives you the most control over the actions of your internet control...specifically, I would like to be able to throttle a connection down at certain points of the day, and send it back up again at night. What will let me do this?

Finally, which of the technologies is best for reading data as it streams in?

These are not necessarily big files but there are A LOT of them, and they are chained together, with pages leading to other pages, etc.

So to sum up, what do you think would be my best bet? Thanks tons.