Or you could plug the hole with a dowel, drill a 20mm (for example) recess a couple of mm deep, fit whatever inlay takes your fancy and then drill a new pilot hole for the the button screw.
Darren