TrayIcon:
Shell_NotifyIcon API.
How To Manipulate Icons in the System Tray with Visual Basic

@Vivek:
Copying the whole exe is not a good idea. That exe may need many other files in App.Path.
Adding just a shortcut in startup folder or, Add/Remove your program to computer startup (through the registry) will do the trick.

Edit: I'm very slow today.