The battery I bought is a duracell dl2025 3V battery and the one in it
is Newsun CR2032 3V battery.

They are different batteries. IIRC, the last two digits signify the
thickness of the battery in 1/10ths of a mm. i.e. 2025 is 2.5mm thick,
whilst 2032 is 3.2mm thick.

Some 2032 battery compartments would not connect properly with a 2025,
whilst others will. 2032s are much more common than 2025s. They have
significantly greater capacity in not much more space.

A folded up piece of foil may sometimes be used to thicken the 2025 enough
to connect with a sensitive holder. This depends on the design.

Christian.