logoalt Hacker News

monkeydusttoday at 11:00 AM4 repliesview on HN

I have a MA system setup for personal use.

You give it a problem, you then refine that problem where a fast, cheaper model asks you questions which you answer to get a better input prompt. You then choose a MA strategy for example take problem break up to sections then final judge concludes or you do multi turn where agents debate then judge summarises debate.

The best approach is what I call 'all angles' where all these strategies run in parallel the final meta-judge synthesise the response - the most useful part of this which I recently added is a view to see the variance in each strategy.

Been using this for life stuff - housing search, schools, family challenges!

Perhaps I should make a video of it in action if people in HN community interested let me know.


Replies

monkeydusttoday at 4:12 PM

Right here is the video demo of what I built - https://streamable.com/e49cgt

chrisss395today at 12:30 PM

You mention cost in one of the replies. Can you elaborate on the cost profile (ballpark) for various problem types? I would also be curious to understand the strategies employed and what the costs look like across each.

Folcontoday at 12:21 PM

Definitely interested, would love to see a video :)

show 1 reply
uxhackertoday at 11:10 AM

So what harness are you using? And what LLM’s

show 1 reply