If a plugin is loaded, the uninstall feature does not work.
It claims the user does not have permission to uninstall on their current account.
I am testing this with a plugin that's just in the same directory as my program.
If I disable it, exit and restart so it was never loaded, uninstall works nicely.
This is on Windows. Possibly Windows's file-in-use difference causes this?