The paper is on drywall right now. What's the best way to get it down
short of taking the drywall down too?

The fence is bugless, it was used in my Bro-in-laws store for quite a
while and I know his Mrs. required it be treated. (I'll make sure and
confirm no bugs, Hadn't really given it a thought... Thanks!!!!

The fence shouldn't really interfere with the heaters at all....