abasel
...I've rebooted a few times but it stays there.
The only thing I haven't done is reconfigure but I'm not sure what they mean by that.
It is not sufficient to do a reboot.
Reconfigure is exactly the thing you need to do as well (ie before) a reboot.
In the server manager software installer panel, there should be a big button at the bottom right called Reconfigure
Alternatively at the command prompt you would do
signal-event post-upgrade
signal-event reboot
The signal-event post-upgrade step is what is commonly referred to as Reconfigure, and is a fundamentally important part of most update procedures, and always followed by a reboot.