alt Hacker NewsI just ended up making my own GUI. I never really liked any of the pre-build ones. It started slow (3-4 days of work) and grew organically around my working style. I can also have my preferred UX (e.g., high information density).
Take a look at the Codex App Server or the Claude Agent SDK as a way to communicate with harnesses running headlessly and build your own UI on top. I’m sure Pi can be set up in a similar fashion.
Replies
I've been building my own open-source coding agent, VT Code, in Rust.
I wanted more control over the harness itself, especially tool execution, sandboxing, approvals, and context management.
Recently built a native macOS app with GPUI on top of the same agent runloop. It's been interesting exploring how the same engine works across terminal and desktop workflows.
I did this for myself several times. I started with winforms and evolved into a full blown clone of ChatGPT.com experience built as a razor/MVC project in .NET10.
I have 2 versions that are just for working on unity projects. One that is for working on the client project. There is also one that I refer to as the ring of power / Death Star that I keep mostly to myself. Eventually, the client saw what I was doing and decided they wanted a custom ChatGPT.com experience for the whole team, so I got paid to build the most recent one.
Using AI to assist with the development of this stuff is the RSI you've been looking for. I'm in a situation where I was only able to solve a problem due to two levels of bootstrapping enabled by custom harnesses. The product the client uses cannot be "one shot" using the latest frontier tools. I had to build an ad-hoc agent loop fit for just that one purpose using another tool that was possible to build via copilot. For example, using copilot in VS over a unity project's scripts might as well be a drunk person throwing darts from a boat compared to a purpose built harness that can execute ad-hoc scripts in the editor environment as often as it pleases.
The client's custom experience is better than ChatGPT.com in many important ways now. It certainly performs better. It will run on safari without doing horrific things to layout and my CPU. You can easily exceed the capabilities of the frontier AI companies in ways that are important if you use their tools cleverly. These companies are great at making AI models. Not harnesses, websites, apps, etc.
I have the same setup. All you need is a server hosted on your own machine and a few adapters to connect them to providers using ACP and various thin client all connected through tailnet. I have developed my own web and mobile applications with gemini live full duplex routing to opus my local projects and maintain the same session across any platform I choose, including Hermes. Building personal software is easy these days.