alt Hacker NewsApple includes a local LLM on all recent iPhones, https://developer.apple.com/documentation/foundationmodels. Seems like a bad idea to force your users to download a 3GB LLM just to parse a text field.
Apple includes a local LLM on all recent iPhones, https://developer.apple.com/documentation/foundationmodels. Seems like a bad idea to force your users to download a 3GB LLM just to parse a text field.
Yeah but I need broader coverage on older phones. No I'm not going for a 3rd party LLM. Foundation Models for iPhone 15 and newer, and a parser for the older ones. Currently training a Word Tagger in Create ML