The plan was to use dimmers to control the light. Also unlikely
that both sets would be on at the same time. Problem is that
someone mentioned that dimmers may not work, so sort of
stuck now.

I don't know how many spot lights you have. It can be a good idea to run as
two circuits with alternate bulbs. This enables a very simple dimming where
you only turn on one bank.

Christian.