Being in conflict with the council would be a big big problem if you tried
to sell the house.

I doubt it. A plastic windowed house in a conservation area is likely to
sell to someone who doesn't mind doing up a house. They won't be concerned
with historic issues with the council, especially as the likely result is
just being told to replace the manky windows that they would like to replace
anyway.

Christian.