I received a reply from Webflow support.
You can manually ‘unpublish’ an old site and publish a new one to the same domain. It uses the same DNS records. The downtime is only affected by the time you take to do this, and the propagation.
So it can be done safely without too much disruption. I will report back once it’s done.
Thanks
Will