Toothpicks work great for this if you narrow them a bit with a knife.
As a woodworker I'm surprised you didn't have that idea :D
(Like, c'mon, toothpicks aren't immutable objects that fall out of question just because they're a bit too large)