I found [ggml] is really easy, educational and fun to use. It is written in C and the backbone for llama.cpp.
[ggml]https://github.com/ggml-org/ggml