I'm not opposed to that. It would work really well for most applied sciences and engineering curricula.
It's a similar approach the armed services use to train MOSes as well.
Making the class pass-fail would also be more conducive for learning as well.
But still, some sort of benchmark would be needed to at least give students the ability to gauge their proficiency.