Hello, i know when i publish an application it asks if i want the program to update from a certain web address. how does this actually work?

Would i set the update path in the publishing to lets say for example

http://www.noahssite.com/myapplication.exe / htm (something like that)

then whenever i want my software to update i would just go onto my FTP server and replace

http://www.noahssite.com/myapplication.exe / htm (something like that)

With the new version of my application? (with the same name of course)

Please help i am unsure about this topic "UPDATING"