That is absolutely how it is supposed to work. When you click on your button, an #anchor is added to the url. If you refresh this url, it will always point to your section.
The question is why at this point do you want to refresh your page? What’s the use-case of this?