Yes you should. I have that setup and they will try to move in if you
don't. I used some screen and that seems to do the job.