No one objected to calling an 80387 or a Weitek chip an "FPU", even though those chips just had simple stack and register interfaces. So I don't think a good case can be made for refusing to label anything from the original Voodoo card forward as a "GPU."