MicroG does an excellent job at reimplementating most of Google's proprietary APIs on the client side.

I don't know how feasible this is, but it would be cool if there were open-source drop-in replacements for Google's server-sided APIs that app developers could use to replace Google's services with alternate servers running open source software.