logoalt Hacker News

NoDodgeQuestion • yesterday at 8:44 PM • 2 replies • view on HN

can you give example, prompt require context window > local model, or higher Quality/Speed, that local model can not do, open source example?


Replies

origini • yesterday at 8:53 PM

Any program I'm vibing.

I write 5-20 paragraphs of things I want and it goes away and just builds it.

Something like this (just an example):

"Build an application with a webserver in rust. It has 4 stages, first one is an input module... second one is refinement ... third one is an image detection with current fitting ml model ... last one is finetuning."

Then i would describe every basic page with a few more paragraphs.

This would work for half an hour or an hour, consume 100-400k of context tokens and then I would test it, write down 10-50 small sentences (every sentence either fixing a bug, or making it better) which tehn takes again like 20 minutes and i'm nearly done with a complex enough tool providing real value and actually working.

A big kimi, which is hard to run, might be getting close to this but we do not talk about running it on 1-2 5090.

The other thing is, thats more like a practical experience, even if you use them through Open Router (for testing and co), the initial results of something like Opus 5.5 are ALWAYS better. More details, better quality, better understanding of usability of the tool.

➕ show 1 reply
simonw • yesterday at 9:54 PM

Here's a prompt I used recently:

> In a work tree build a feature where each column cog action menu has a "Column statistics" item - clicking that item opens a modal dialog which displays statistics about that column - for text columns that's most common values, stats about value length - for numeric columns it's more interesting than that. Let's do a bit of percentile analysis in there too. Under the hood it works by firing off SQL queries using SQLite window functions and suchlike. For the moment let's have that option only available if SQL queries are allowed against the database, and the SQL queries are built in JavaScript.

You can see a screenshot of what Opus 5.5 built here: https://github.com/simonw/datasette/pull/3038