You're best bet is to go to a tool rental place and see if they have a
scraper that is used to remove vinyl flooring from a concrete floor.
They are electric and work very well. I recently used one and it did a
very good job but it's not an easy job. It will remove everything
right down to the concrete. Good luck.

Doug