Thanks for that @shokoaviv!
The solution was to remove the column, then use two div’s. One for containing everything, and the other to contain the text and the form.
For the button, I just set the form block to relative, and the CTA button to absoloute. Then I played with the spacing and now we’re all good to go!