It's impossible to say what sort of improvement (if anything) this will give.

My assumption is the determining factor in performance is going to ultimately be memory bandwidth.

> and if unified memory plus a basic GPU will render this dead in the water?

Yeah, generally I think that is the case. The main benefit this thing would have is power consumption will likely be lower than what it is to send this operation to the GPU.