There is a page in the Webflow University that I recommend you review if you haven’t.
It should help you resolve your issue.
Connect a custom domain | Webflow University
Glossary Term: DNS records | Webflow Help
If you are still stuck, let us know.