In some sense everything an LLM does is by unprincipled methods. But it works! We judge it empirically post hoc by its performance rather than relying on tuning.

Hell, human thinking is unprincipled in basically the exact same way.