A hospital is going to remove a plaque unveiled when opened by disgraced Andrew Mountbatten Windsor, it has been claimed.