XQuartz performance has been broken for a couple of years now and I believe it is primarily due to an OpenGL issue.