Honestly, I always assumed that consensus was that replication is the hardest part. I believe we have almost none of the technologies required for that.

Whenever I read of von Neumann probes I always thought "How can that even made possible?".