Seems legit. I speculate their are emergent mechanisms for the development of memory that are not dependent on what ever mechanism is behind the "improve $model for 'everyone'"*

Is someone knowlegeable on research that engages the question on the development of something that could be considered as some emergent mechanism of memory, that is independent of instances and their contextwindow an specifically also independent of the use of conversations for trainingsdata?

*(This is regarding the value of selfhosted models - maybe small selforganisations that share ressources to do though to do so? Generally the value of machine learning seems to be to big to reject)