I think taking the chimney out of service and venting to an outside
wall as suggested by another poster might be the best alternative.
What do you think?

YES costs less. and if you go with a new direct vent 90+ furnace you
will save big bucks on heating.

hot water tanks can be direcect vented too, although if your tanks are
old it might be better to just replace them