I think what's still a bit unclear is how the action space gets linked to a plan. Did you create your own action prototypes, or are you using ones exposed via an existing Skyrim world state interface layer?

How often are you running the world JSON through the planner? When do you give up on fuzzy matching if an action doesn't fit?

Do you use any vision tools? such as the plugin from https://github.com/MinLL/SkyrimNet-GamePlugin

Super cool project btw, thanks for sharing!