I am not sure how someone would run an LLM on my computer to look for exploits as the source code is only available on my machine?

The old human nature tendency of "Just ship it!" and the desire to move on to the next shiny thing on our wishlist doesn't go away with AI. If it anything, it makes it worse.