Quote Originally Posted by kupo kupo View Post
Thank you for the info dilettante. I did a little research on spiders/crawlers and they seem very much like my objective. Do you have any advice on how to go about creating crawlers based in vb.

Also, my target site is actually local government. Would they react in much the same way as a commercial site? Why do commercial sites not like being spidered. Doesn't it mean more traffic for them?

Sorry for all the noob questions. Thanks again.
Traffic isnt always good and If its goverment then its likly they may react worse

What are you trying to do?