logoalt Hacker News

gmaszzyesterday at 2:51 PM2 repliesview on HN

chrome://on-device-internals/

..will tell you everything you need to know - including model state, file path, device capabilities, etc.

And there's a single button to uninstall the model.

There is also the ability to load a model from a central location, as suggested by another commenter here, although I haven't tested it yet.

The official chrome.dev Prompt API Playground linked in the thread doesn't work.

Chatgpt made a me tiny chrome extension to test the prompt and summariser api's when they announced last year - my laptop wasn't capable the time but these newer models are obviously smaller and more efficient, so it has sprung into life.

Full prompt and code is on pastebin `7Ja3ATHZ` if anyone wants to test quickly. It summarises the current page and brainstorms app ideas based on the summary.


Replies

dmarinustoday at 6:57 AM

You can load a model from this page but it's only for testing purposes on this page and it won't be used for the Prompt API.

gmaszzyesterday at 3:25 PM

While the official Prompt API Playground doesn't work, the one for the Summarization API does...

https://chrome.dev/web-ai-demos/summarization-api-playground...

and you can watch it generate the output token by token in the Event Logs:

chrome://on-device-internals/