Never reduce the diameter with a sharp tool. Timber is a natural product and expands and contracts. Take a hammer and hit around the end of the pole to flatten it just enough to bang the handle home. The timber will return to its original size and shape and give a solid tight fit. Wack the screw in and bobs your uncle 👍