If you're not limited to a polyhedron, a thin rod standing on end does the job.

A rod would fall over with a big clatter and bounce a few times. I wonder if there's a bistable polyhedron where the transition would be smooth enough that it wouldn't bounce. The original gomboc seemed to have its CG change smoothly enough that it wouldn't bounce under normal gravity.