This avoids running the entire role if you just want one new plugin.
It intentionally makes you restart Jenkins so you can put it in quiet
mode, wait out any jobs and then restart.