On Mon, 07 Oct 2013 11:45:57 +0100, The Natural Philosopher
wrote:

Any recommendations?

You've just described an mp3 player I bought years ago. Size of a
matchbox, runs for hours recording/playing, takes SD cards, AAA cell.
I'm utterly sure such available now would better it and cheaper too.