I tried a bunch of terminals and ended up switching back to xfce-terminal, fastest I have tried by far. (It's just the default that ships with my distro.)

Actually I think xterm was even more performant, but the eye sore wasn't worth it for me.