Make sure that the .NET framework is installed on the target machine. It will be needed for every machine that is to run your exe. Also make sure that it is the same version as you developed on.

Also if you use any COM objects they will need to be registered and on the machine in question.