There was a physical speaker built into the cases of early PCs. Later on, there were a couple leads on the motherboard where you could plug in a speaker if you wanted to, but you weren't required to. I'm not sure those leads even exist anymore, at least not on a lot of motherboards.