logoalt Hacker News

Ask HN: In your experience, what are sound conventions for e-ink UI development?

184 pointsby BoxOfRainlast Friday at 5:29 PM59 commentsview on HN

TL;DR I'm looking for advice regarding browser-based frontend development from people with practical e-ink UI experience. My specific device is a Bigme Hibreak Pro BW but I'm aiming for relatively broad compatibility.

I've recently switched to a black-and-white e-ink smartphone with the motivation of withdrawing from the attention economy somewhat and it's a genuinely cool piece of hardware. While the majority of my needs are met by this device there are a few things I'd like to have which don't work terribly well with the e-ink screen. I'm planning to implement a couple of projects to fill these gaps, at the moment I'm planning a Lemmy frontend and an OpenRouter frontend specifically for e-ink. Both are to be browser-based rather than native, to maximise compatibility and because I'm much more familiar with the web than Android development.

I would like to study the principles of sound e-ink UI design before approaching these projects to avoid creating unusable slop, in particular I am not entirely sure how to approach treating the refreshes as a first-class aspect of the design when I can't control them from the browser, and how to apply comprehensible UI conventions when a greyscale, high-contrast display is the target.

Some specific problems I have out of the gate are:

* Streaming LLM output to the screen is basically the worst-case scenario for e-ink, I need to buffer it and paint it in chunks without this becoming horrible to use.

* Ghosting is a serious problem, browsing HN on the device is a particularly obvious example. Ideally I want to avoid scrolling as far as possible and rely on pagination instead, which I feel has the potential to become annoying if not done well.

* Given I must rely exclusively on layout and type to carry the UI, what design languages emphasise these qualities best? My gut says the early Mac OS versions wouldn't be a bad place to start, this seems relevant given the display constraints of the early macs.

I would greatly appreciate any advice on the design and implementation of e-ink UIs from people with practical experience in this area. This is purely to scratch a personal itch, once they're nailed down I'll put them out in the wild under the GPL.


Comments

dredmorbiusyesterday at 8:34 PM

Funny you should ask, something of a bugbear of mine:

1. Persistence is free.

2. Pixels are cheap

3. Paints are expensive

4. Refreshes are slow

5. Colour is limited to nonexistent.

6. Pagination over scroll.

7. Full refresh (of page or portion) over pan.

8. Reflective rather than emissive.

9. Minimise animation.

10. Line-art or halftones over shade gradients (images).

<https://news.ycombinator.com/item?id=31396797>

I've reiterated (and occasionally revised) that a few times, see:

"E-Ink Design Principles for Web and Applications" <https://diaspora.glasswings.com/posts/638a8d10e041013afba844...>

That's source of the above list, gives a bit more explanation and rationale for each choice. I wrote it after failing to find any UI/UX development guidelines myself, and have had some positive responses from it.

And on HN, search for "pixels are cheap" by me: <https://hn.algolia.com/?dateRange=all&page=0&prefix=false&qu...> (about 15 results, this comment included).

show 3 replies
freeone3000yesterday at 4:14 PM

I’d focus more on print usability and readability guidelines than computer guidelines. 5Hz eink is closer to a moving newspaper than a slow computer.

https://www.mediapoint.com.au/design-tips/composition-layout... might be moderately helpful.

But my advice: do not count on anything refreshing ever. Do not have animations, or transitions. Preload things to the correct spaces, then fill in. Reserve fixed white areas for output, and then fill in with black. (This works much better than the reverse!)

For quite long running processes, it might be worth having it behind a second page load.

show 5 replies
ronakjain90yesterday at 6:58 PM

TRMNL recently open sourced a CSS framework made specifically for ePaper display [1], you can use the opensource firmware[2] and quickly hack together a good solution using off the self components.

Disclosure: I work at TRMNL.

[1] https://github.com/usetrmnl/trmnl-framework

[2] https://github.com/usetrmnl/trmnl-firmware

FabCHyesterday at 8:50 PM

I use eInk as my daily driver and do everything including ssh into tmux into vim and code on eInk.

I build all my UIs with Rust and Ratatui. It works very well.

So for web, I think it would translate to:

0) NO ANIMATION. You have like, 0.3 fps. You might poke somebody’s eye out if you animate something.

1) NO SCROLLING. Pagination only.

2) Use actual added visual element to tell the user where their input control / cursor / selection is. Don’t rely on color, font weight etc. Put an asterisk, Unicode arrow or something.

3) Direct(?) action controls. A button should DO something. Don’t give me a button that opens a drop-down that opens a menu to do something.

4) Use the whole screen! Keeping a pixel on/off costs nothing. Only changes do. So any whitespace is just sacrificing screen real estate and forcing more frequent changes.

show 2 replies
philosopherNoobyesterday at 4:53 PM

Spitballing an idea. I don’t use e-ink stuff but had my hands on it back when personal readers were new to the market.

When scrolling arbitrary text on a computer via keyboard, I generally become mildly frustrated hitting Spacebar, PageUp, and/or PageDown because I lose continuity with what I’m reading. (Perhaps the momentary 60hz blur makes it worse?) I attribute that to having a hard time identifying where I last read.

If there’s a dedicated button to scrolling, consider having an adjustable distance. EX: 100% screen height down, 95% screen width down (keeps a sliver of the last page), or 80% screen width down (keeps a chunk of the last page).

If you’re working with a touch display, perhaps a hold-and-drag-to-scroll feature could work? Have no indicator when pressed and only refresh the screen when the user lifts their finger. (It’s certainly not ideal to provide no feedback that it’s being used. But it may be useful to a user aware of how it works. Would probably need a training demonstration in-device like what older operating systems had.)

Perhaps a dedicated scroll undo button? For when one makes a mis-input and wants it back where it was. I know I’ve seen my grandma get frustrated at that sort of thing on desktop/phone where it’s quick to fix.

show 4 replies
tracker1yesterday at 5:08 PM

Beyond the early MacOS UI/UX, I would look at pre-smartphone devices as well. Palm pilot, phones, etc. These will give you ideas on what you can accomplish with lower resolution UI screens.

For that matter, look at good TUI applications... (not the render path, but the result as a whole) ... blocking/spacing and clear controls, etc... though you'll be more touch, less tab/enter, etc. A TUI App renders by characters, but you can still learn from the overall layouts. Simplified menu lists with fewer items in a hierarchy, etc.

If you can and have physical buttons, think long and hard about their functions, especially if you have a limited number... these should do your most important things.

show 1 reply
longnguyenyesterday at 4:38 PM

Not a web UI, but I recently built this[0] for my Boox Note Air 5c tablet. You may find it useful (check the source code in GitHub)

[0]: https://inka.page

show 2 replies
Melatonictoday at 5:06 AM

What if instead of pagination you have the screen mostly blank out when scrolling ? Maybe with the exception of an indicator bar at the left or right to show how far you have scrolled. Could be very thin and functional. On stop it would refresh the page / text

samschooleryesterday at 10:39 PM

I actually built a Partiful event clone [0] for my friends and I and this was one of the first features. One of the "unlocks" for me was a scroll component that auto paginates any screen on the site. I have The Minimal Phone and it works quite well as a PWA. Not at all a promotion (like actively I'm losing money on this product) but feel free to check out eink mode. You login with 4152127777 and test code 123456 (going to disable this tomorrow fyi). eink mode is in the top right profile menu.

I wish these phones complied with `monochrome` media query [1] but they don't.

[0]: https://littleinvite.com/e/vfu8mn4b/test-invite

[1]: https://developer.mozilla.org/en-US/docs/Web/CSS/Reference/A...

blululuyesterday at 7:06 PM

If you are just trying to get something quick and simple that works for rendering react components then this repo is solid:

https://github.com/marcomattes/epaper-components/tree/main

The Bigme is a pretty high quality eink display, but some core properties of eink are present here so I’ll offer some generic guidance:

The contrast on any epaper display is lower than on a modern lcd/oled display. So you want to avoid or modify ui systems that try to diminish contrast for stylistic reasons. Or more explicitly: maximize the contrast wherever legibility matters. It is pretty common in pretty much every modern design system for web/mobile to diminish contrast so you may just need to go in and tweak things yourself.

Second: you cannot rely on color as an accent. A lot of UI does this (submit buttons). Defining a consistent accent pattern is necessary to replace patterns that rely on color. This can be outlines/borders or inversions.

Stylistically I think that sharper content looks better on eink than smoother content, but on a 300 dpi display with 16 grays this is less of a hard point.

show 1 reply
storywatchyesterday at 8:56 PM

A lot of times the e-ink display can handle much higher refresh rates but the driver board and software are trash.

See the modos for what a clean sheet eink design would look like.

https://www.crowdsupply.com/modos-tech/modos-flow#products

Marsymarsyesterday at 9:00 PM

Asides from what's been mentioned, I'd suggest big touch targets. Because the UI is so slow, it's comparatively painful to miss a touch target, especially if the result of a miss is a UI refresh that then has to be undone before the original action can be retried.

ckztoday at 1:04 AM

@DANmode and @storywatch both called out good paths to explore.

I daily drive a monochrome PDA as my core "smart" device. The overall UX is excellent for what it needs to do. Despite color PDAs being widely available, I've found I prefer the B&W UI quite a bit more.

A common refrain from me is that digital calendar UX peaked somewhere around 1999-2000 with PalmOS 3.5 (particularly on later Handspring Visors). I've also written most of a little weather app using native UI elements for them.

Additionally, the Modos folks seem to be on to something with high refresh rate eink. It's quite smooth in practice and is almost uncannily like a normal LED screen with an e-ink look.

Early Macs also had pretty opinionated HIGs, as you said.

Feel free to reach out if you want to chat further. Frankly a lot of the design principles are the same as broader graphic, type, and UI design best practices--they just aren't often followed by anything modern. Something that's always stuck with me from a professor was that a good logo must pass the "fax machine test". Seems quite applicable to this day in an eink context! :)

Link to some PalmOS UI guidelines: https://cs.uml.edu/~fredm/courses/91.308-spr05/files/palmdoc...

^ These are a bit newer and include color. The UI elements originated in mono and were still backwards comptaible with mono devices, so I find the addition of the blue to be distracting rather than additive, but YMMV. Either way they also look much better on a proper 160x160 LCD vs a PDF!

pshcyesterday at 7:32 PM

I've been experimenting with a Remarkable Paper Pro.

Additive inking works pretty well. As long as I am adding black ink to the page, everything is responsive. But if I want to push other updates asynchronously, or (god forbid) erase something, then there is the danger of clobbering the user's inkwork. I don't have any deep insights here, beyond waiting for human confirmation before updating anything.

I wonder if it is possible to detect when the pen tip has "left" the proximity of the page? If I knew this, I'd know when it was safe to update the UI.

I have decided not to use any scrolling at all. I am paginating everything and positioning input areas near the vertical middle of the device for comfort.

GICodeWarriortoday at 12:29 AM

While not as good as a proper refresh, you can use alternating black and white drawing to help clear an area of the screen.

ramses0yesterday at 5:30 PM

Look back to the olden days of "drag proxies" or outline/wireframe drags.

Specifically for your example of maps, I would stick mostly to border buttons or UDLR gestures to "page" around rather than than trying to show a smoothly refreshing drag area.

Since you can _see_ the screen refreshing/drawing, and assuming you're using +/- buttons instead of "pinch to zoom", try drawing animations "in layers", ie: spend 100-300ms slapping "zoom tunnel boxes" trying to keep the user oriented while interacting.

Break the tiles into "thick => thin => letters => detail" and wait for them to quiesce before stacking more layers.

Rule #1 of optimization, you can never do something faster, you can only "do less"!

Rule #2 of optimization (amdahls law?)- optimize the slowest parts before you optimize the faster parts (and there's a limit to each!).

...from an end-user perspective, I would love if you respected my time and concentration when doing something "interactive".

Imagine scrolling through an e-ink address book. Imagine you spam only the (properly placed / laid out) first letter of first name and first letter of last name, and then after ~500ms of no movement, only THEN write out the remaining letters, phone numbers, icons, etc.

For e-ink interactive: every (slow, expensive) pixel that you write that gets scrolled off the screen is wasted time.

#1 - do less. In interactive cases, draw less pixels.

#2 - keep context. Use proxies/wireframes, "first letters", and "bold strokes".

#3 - fill in layers. Think "iterative Mona Lisa" and "progressive jpeg"

#4 - actually being slower is okay if you end up "feeling faster" or "seeming cooler"

Lean in to the defects and quirks of e-ink, make them feel intentional rather than trying to duplicate 60fps 16M colors.

purplemoonxtoday at 4:34 AM

Dynamic Pricing

Bad for consumers.

Great for e-ink device manufacturers.

Now we got this e-ink UI dev.

I don't like it one bit Tony

hirako2000yesterday at 8:41 PM

Rmkit is a great foundation.

Not browser based. Not sure why it would matter.

appendjeffyesterday at 11:08 PM

There are some inspiring design ideas buried in the settings of einkbro and boox device settings.

https://github.com/plateaukao/einkbro

show 1 reply
jeffnashlast Sunday at 6:51 AM

If you find out, let me know! I have been working on a port of Excalidraw to my ReMarkable Pro and it's opened my eyes to how much we take for granted in terms of UI interactions when we assume we have a 30+hz screen with no to minimal ghosting. Layout has to become as monotonic as possible, especially in the absence of user interaction; in other words, the app itself should never be doing anything to disrupt prior renders on its own unless you are clearing the whole page. When it is the user interacting with the app, try to minimize the number of intermediate states their interactions produce. This does NOT mean "just don't render those intermediate states", however. It means make the interactions themselves not require intermediate feedback. Essentially, users (and developers) are so accustomed to just being able to manipulate things with no side effects that you have to make every possible interaction as intentional as possible, leaving them less frustrated when they do see a refresh. If an operation is going to cause a refresh, it should happen at a moment the user already understands as a semantic boundary.

You obviously cannot always avoid this, so when there is a hard requirement for continuous feedback, use a degraded/cheap transient representation and refresh at commit of that action. With E-Ink, every interaction has to be a trade off between ghosting and latency. One common pattern I ended up coming back to is intermediate states that optimize for latency at the expense of ghosting until the UI action is 'complete'. This will allow refreshes to be associated with the satisfaction of finality. Funny enough, many of them harken back to old UI paradigms from when computer graphics weren't as powerful as today. When resizing, I simply draw the outline of the shape with a fast update mode that tolerates more ghosting until the user releases their finger or stylus, at which point, after a small lag to account for an 'oops, just a tiny bit bigger/smaller', I do a localized refresh of the union of the old + new area.

The outline itself is deliberately faint, so the refresh doesn't have to be as intense if its a small delta.

For your streaming LLM case, I would recommend doing it in chunks, like you said, perhaps doing a hard refresh of everything but the input box + moving the tail of last sent message + beginning of stream to the top upon send. Of course, this implies that you know exactly how long the response will be, which you don't. The challenge will be coming up with a UI paradigm that doesn't make it look awkward if the response only goes down to the middle of the screen while also nicely doing a clean refresh pre-emptively if it's clear it will overflow and need to move to the top. For the former case, find some way where it looks not completely awkward if it's partial and then do refresh of the chat history area and move it to its proper fitted position once the user clicks on the input box again to type their next reply. For the latter, perhaps embedding some kind of remaining space meter at the bottom that indicates when you'd need to do this move + refresh action (don't directly label it that way) would enable the user to anticipate it more and be less frustrated when it happens, as they are psychologically awaiting the next part of the answer/reasoning, not surprised at a sudden flash.

For the actual streaming, you'll have to ensure that your text alignment works in such a way that once a line is rendered to the screen, its placement is final (in other words, no streaming intra-word, as you need to know if the word will fit in remaining space on the line before rendering it). Basically, avoid retroactive reflow like a PDF document with a fixed layout, not like this text box I am typing in with a resize handle at the lower right. You'll also probably want to disable scrolling during generation as well, or at least make some sort of discrete pagination mechanism for going back and forth.

In any event, I look forward to seeing whatever it is you're building!

show 1 reply
DANmodeyesterday at 6:20 PM

Just buy a Palm Pilot, and/or review old PalmOS screenshots.

Not kidding.

show 1 reply
Anvil3212yesterday at 11:07 PM

[dead]