I'm going to insulate anyway. But there is no way a conservatory would
meet
general building regulations. Perhaps the exemption is finished, but only
a
tiny subset of rules apply?

Let me make it a bit clearer. Yes the standards for conservatories is lower
than other extensions. This does not alter the fact that they are, if
attached to the main house, subject to building regulations approval.