I have a fairly simple program that uses the WebClient to go and download a URL's source code and pulls specific information by using Split. Though, if if it hits a redirect, it doesn't redirect itself. Which I've tried to correct by using the WebBrowser, though it's also not picking up the redirect. An example of what I mean is, for instance Sears.com, when you run a search. It runs it through and produces the results. If it returns only one item, then it redirects to said item.

(Note: Sears.com isn't the website that I am scraping, it is a mere example. It states in the Privacy use that web scraping is against the usage agreement)

How exactly would I allow the WebBrowser to accept the redirect? I tried to do a Do....Loop where it would check the URL until it's different from the search, and then scrape the information, but as you can figure, it doesn't work that well. Any other ideas?

Thank you