So technically once you have training data via an expensive classifier on NL data, there is no reason one cannot reduce the footprint of the OP classifier to a very small one. I imagine they could just automate feature selection in a SVM(cross validate on CPU!) using an evaluator to train an optimal one.