Maybe there is a workaround without having to rebuild all of the CMS collections to static content on the site manually?
Edit: It appears this might be a solution: Export CMS site as static site - #7 by leonardomattar and How to export a CMS based webflow site to a static site