logoalt Hacker News

malfistyesterday at 2:30 PM2 repliesview on HN

That's a research paper. Can you point to a single product that claims they use an LLM for their spellchecker? With today's investor market, surly that would be something a company would brag about.


Replies

kdavisyesterday at 3:43 PM

Craig Federighi SVP of Software at Apple “The keyboard now leverages a transformer language model, which is state of the art for word prediction, making autocorrect more accurate than ever.”[1]

"New features available with macOS Sonoma" doc states "Autocorrect fixes mistakes for you more accurately than ever before by leveraging a new transformer language model in English, French, and Spanish keyboards." [2]

"Introducing Apple’s On-Device and Server Foundation Models" blog post states "Apple Intelligence is comprised of multiple highly-capable generative models that...have been fine-tuned for user experiences such as writing and refining text.. In the following overview, we will detail how two of these models — a ~3 billion parameter on-device language model, and a larger server-based language model."[3]

"A look at Apple’s new Transformer-powered predictive text model" blog post[4] is the kind of deep dive you'd have to do to find out what's going on under the hood in your spelling/grammar checker. TL;DR AppleSpell uses GPT-2 which proves my point.

[1] https://eu.usatoday.com/story/tech/2023/06/06/wwdc-2023-appl...

[2] https://www.apple.com/mideast/macos/sonoma/pdf/en/macOS_All_...

[3] https://machinelearning.apple.com/research/introducing-apple...

[4] https://jackcook.com/2023/09/08/predictive-text.html

show 1 reply
kdavisyesterday at 2:44 PM

This wasn't your original question, which I answered.

This "moving the goalposts", requiring me to know the internals of say a closed source product, just proves my original point. I can't know if an LLM is being used because I don't have the source code.

show 2 replies