Until he has built a building without permission, he hasn't done anything

Could he be claiming that it is an agricultural building? I don't think
(don't know) these are subject to planning permission. Presumably the
land would then have to be designated as farm land.

Agricultural buildings are subject to planning permission and have been for
many years.

Peter Crosland