Should be possible with custom code but it may be a bit janky.
I think the easiest approach would be-
Add a form submit handler ( Webflow will already have one installed ).
On triggering your handler, delay 500ms and then make sure the form block is visible.
It will be hidden if the success message has appeared.
You’ll probably also need to decide if you’re clearing the form fields, or keeping the previously entered data intact.