So just squirt the foam in and level it off below the level of the
frame and then later use acrylic sealer on top?

I have always found expanding foam really messy and difficult to
control, which is why I was not so keen to use it, so any tips
gratefully received.