I did this at my last job. ComplementNB trained on ~30,000 examples (which were freeform text, and very unbalanced across categories) in under a minute on a laptop CPU, and with log-weighting of scores, was about 85% accurate. I don't remember how fast it was at evaluating the tickets beyond 'basically instant', as it was a proof-of-concept that got cancelled by changing ticketing system.