alt Hacker NewsI'm curious what people are building with these models
Replies
it's actually more usefull than it looks. it is not much useful on its own but it can play a big role in a complex workflow or custom harness.
i used luna 5.6 as the ranker/filter to remove useless items from upstream rag(mixing embedding, regex etc) and it did a good job but took 5-10 seconds each time. now less than 1 second and no observable precision loss. hope it helps
Automatic tagging of images is what I'm doing with it. I'm using a modified Gemma model, which ingests images (and audio, for that matter).
I've used it in a bunch of places, but my favorite use. I have an app (https://plonkit.app/) i'm the only user... because i built it for myself. In the app I have a shopping list feature. When you add an item it auto assigns it to the right shopping list. It's a very simple feature, but with Jev, it's quick, and it stayed simple.
You can turn a lot of process and workflow systems into deep decision trees.
My team hasn't finished writing their blog posts yet, but the customer demos [2] went out the moment TypeSafe took our call and sorted all the paperwork out.
There's a tiny section at the bottom of the demo which explains how it actually works (or the github repo is the code).
We have a single decision API[1] over all similar models, so we run evals across all the "System One" api products & definitely don't trust any benchmark that you haven't run. All standardized benchmarks have been benchmaxxed already.
PS: just in case it wasn't clear, the demo is a game where we play to calibrate the human vs machine decision making (or just do it in auto-pilot mode).
I found an example online, I cannot find the github again, but it was interesting: an instant dynamic generation of React component, you type what you want to build using natural language, and it directly add one to the page.
If I remember well, in the background, it does the multi-choice question: "What is the component requested ? --> Calendar, Slider, ..."
Anything that can't be solved with a regex and LLM feels like an overkill. There are surprisingly tons of things that falls in this category. E.g Filter, classification, preprocessing micro decisions, etc.
It’s good for automatically categorising or reviewing stuff which is free text.
Judging from the tilte, I guess dreams.
Silly toy experiments: https://letsplay2048.lol/
scoped classification
Effort router. Dynamically changes the reasoning level for OpenAI and Anthropic models based on Jev's perceived difficulty of the task to be done. Only these two providers can support this because they both support changing effort level without busting the cache.
I use it as a drop in replacement for LLMs I had previously doing filtering and classification in a pipeline. It's loads cheaper and faster with roughly equivalent performance on my own internal tests. The confidence scores (which are also reasonably well calibrated on my data) are a super nice bonus.