Definitely worth following for ideas.
How did you solve memory in your system?
I ended up using QMD + custom skills to keep it up to date as new data comes in. Essentially a cross-referenced set of markdown files forming a knowledge base: https://github.com/tobi/qmd
Didn't know about qmd.
I use a mix of markdown notes, an sqlite database, and my image store searchable by text. I use immich.
For now I do it manually by giving it skills for each data store I wanna access.
My usecases are all ad-hoc I am not a "pro" user by any means. So I don't mind some manual work.