Plug the narrow part of the wood with packing peanuts or some other pre-made foam.
This way you can remove it if you have/need to.