You can do this even more efficiently with the rust crate bonsai. You will have more control and you can create sceneries of logic. You can use incredibly cheap models this way and get way better results.
I built a real time character story. In which players interact and integrate fictional characters. There is no delay in response and the characters are all in character. Oh and it’s all voice.
It’s shocking how effective this is.
do you have a write up of this?
Where can I read more about this!?
I don't see how "bonsai + cheap model" is any better than the solution they used which was just "cheap open-source decision model that can be run internally at Amazon".