If you can identify what it is that’s broken in your HTML, you can export your CMS, make that fix within the CSV, and re-import it. That will likely require some python scripting or other means of correcting your HTML structure to work properly in a Rich Text Block.
If you preserve the ItemID column, Webflow is good at identifying this as an update rather than loading additional records.