We should remove the registry key we create with the Launch on start setting:
Software\\Microsoft\\Windows\\CurrentVersion\\Run\\CoderDesktopApp

We need to be careful in the update path so we don't clear this setting.