2620v4 is not a power slurping beast. Depending on the server board, it might not be either. Servers are often loud, but it depends.

There's a lot of budget hosting built around chips like these, and they're suprisingly power efficient.