One thing is that when cutting with a gouge you use full body motions
without significantly rotating the tool.

Sharpening involves more hand movement and rotation of the tool, making it
more difficult.