Finding all the pages in a whole site?

[SteveCRM]

I want to make a program that saves pages so I can view them offline. But is there a way to get all of the pages incorperated with that page too? It isn't worth it just to find each site and save it, can I get these automatically?

[Zero]

Not bloody likely. The HTTP protocol has no accomodation for searching out something on a server, nor does it have wildcards (things like *.*). Just think what would happen if something like THAT fell into the wrong hands... One could walk right around security checks at Hotmail and porn sites by downloading everything and then ignoring the password page. To end my rambling, if you don't have a specific URL, you're going nowhere.

However, if you wrote a program that would search through HTML for links, you could indeed get the specific URLs for everything VISIBLE on the page. That's worth a shot.