In-page linking is off

I am using in-page linking, but it scrolls to the sections with an offset.
Here is a Loom of the problem:

What do I do?

Don’t trust the designer view for that. Publish it and check the published site to check the actual behavior.

If you’re still seeing issues, share your readonly project link and your published site link.

Still happening:

Ezra’s notes here may still be relevant.

To be able to do this I might have to remake my whole navbar.
Currently, I use a basic div with links inside.
This setting is only available in the navbar element.

I didn’t like this element though, was kind of annoying to work with.