alt Hacker NewsThe easiest way would be to setup some cameras and start recording everything. Gemini could already sort that into events you could query. If you have privacy concerns, at the current pace of progress, local LLMs should be up to the task soon if they aren't already.
Another nice benefit of this would be location tracking. Once you had established the database of tools and the CV setup to recognize them, you could ask the LLM, “where did I last place my Stanley knife”?