It's better to use the vs2003 Setup and Deployment Project to create a setup files. It will include all the dependencies that is needed in your exe.

You also can manualy copy your exe to the target marchine, but you have to
1) install .net framework
2) copy all the related dll.