logoalt Hacker News

Turning a MacBook into a touchscreen with $1 of hardware (2018)

392 pointsby HughParryyesterday at 7:22 PM199 commentsview on HN

Comments

wildrhythmstoday at 1:19 AM

"We've done tons of user testing on this, and it turns out it doesn't work. Touch surfaces don't want to be vertical. It gives great demo but after a short period of time, you start to fatigue and after an extended period of time, your arm wants to fall off. it doesn't work, it's ergonomically terrible."

-Steve Jobs, 2010

https://www.businessinsider.com/steve-jobs-touch-screen-mac-...

show 14 replies
dotBenyesterday at 8:46 PM

I wouldn't want a touchscreen MBP even if it was free, anyone else feel similar?

I don't get the draw - we already optimize for keyboard commands to avoid living our fingers over to a touchpad. Why would I want to start clicking on my screen?

If you're using your computer for tasks (rather than entertainment) and you're not a visual designer, I don't get why Apple are apparently going to be putting them into the new MBP line later this year.

show 26 replies
Zobattoday at 12:20 PM

My previous work provided laptop had a touchscreen and I miss it (for the record, the screen didn't fold 180). It was useful about once a week and I completely forgot about it the rest of the time.

Two primary use cases. Sitting on the train with the laptop in my actual lap it was often more convenient to reach for the screen instead of the trackpad, especially when I had someone sitting next to me on the right and I didn't want to stab them in their ribcage with my elbow so I could reach the trackpad. Second use case was often scrolling while reading, for some reason (phone-scrolling-indoctrination I guess) it felt natural to scroll using finger on screen.

The screen was never my primary pointing device but it was always an option. I think it was annoying a handful of times during the two years I had it, you point at something on the screen and end up clicking something.

solfoxyesterday at 8:24 PM

Love it! I appreciate the ethos of doing more with existing hardware. Adding an actual touchscreen would add real COGs to a macbook, and many potential failure points. Using the existing camera hardware + software seems to produce a "good enough" result for most people for casual use. I'm sure with some time and eng, Apple could make the "hack" shippable. But it doesn't earn product managers the big big bonuses, so it'll never happen.

voidUpdatetoday at 7:17 AM

> "Filter for skin colors and binary threshold"

Which skin colours? The image below that has a lot of colours that I'd associate with darker skin colours, and they're not included in the triggering zone. I'd be interested to see some data on hoe well it works with someone who has dark skin

nothrowawaysyesterday at 8:50 PM

Touch screens are not pleasant for laptops. I prefer not to have them.

show 2 replies
wekyesterday at 11:18 PM

This is cool. Simple prototype. Is it dependent on lighting ... what if you are outside or backlit or glare etc...?

Jabrovyesterday at 10:20 PM

What a super neat application of computer vision. Cool writeup. Thanks for sharing the code and making it open source too!

ianberdinyesterday at 9:41 PM

I was laughing so much. Thank you. Unexpected tech!

83457today at 1:15 PM

Reminds me of Johnny Lee's Wii-mote projects...

http://johnnylee.net/projects/wii/

BugsJustFindMetoday at 2:07 AM

Ignoring whether touchscreen laptops are actually a good idea, I "OOF"ed out loud at this line.

> Filter for skin colors and binary threshold

Skin has an extremely broad range of colors that are also lighting dependent. I'd have gone with background subtraction.

coef2today at 12:36 AM

People use their laptops under various lighting conditions. I can imagine it would be difficult (or likely impossible) to bring this PoC to a solid production level technology. It looks like a fun project though.

show 1 reply
long-time-firstyesterday at 8:51 PM

This is amazing. They should start to install upward looking cameras to implement this officially.

p0w3n3dtoday at 6:41 AM

I almost hear that screen cracking when accidentally closing macbook with the camera inside...

I love Mac since I started using it in 2020, but boy this hardware is fragile. I am scared that I will be held accountable for fixing a broken screen of my work MBP

DubOfWeektoday at 5:34 AM

I don't even imagine how I would be tapping on the screen of my MacBook, not because of its form factor or design, but because of the macOS system itself. It's a different story with the iPad where you can do it endlessly...

joaohaasyesterday at 10:35 PM

As other people mentioned this is obviously not something I would want in my notebook... but I can still appreciate the cool tech!

I can also definitely see this kind of thing being used in things budget outdoor displays, specially if the UI is made to accommodate the lack of accuracy, and the camera is positioned on the side (since these displays are usually vertical).

show 1 reply
dhbradshawtoday at 12:48 AM

Don't love touchscreens that much.

But I did love my Toshiba Satellite. It was like writing on paper!

Down with capacitive screens and long live Active Digitizers!

spidermonkey23yesterday at 8:21 PM

Using an external webcam is that not more than $1? cool project though; reminds me of how you could use a Wii remote to create a interactive whiteboard.

show 1 reply
JaredCampbellyesterday at 9:19 PM

It feels real because of the dirty touchscreen.

show 1 reply
zuhsetaqitoday at 4:29 AM

I always say, people who want a touchscreen on their Laptop never used a really good trackpad. I never missed a touchscreen on my MacBook but when I do something on someone else’s Windows Laptop I often prefer to touch the screen because the trackpad is just terrible.

callamdelaneyyesterday at 9:44 PM

The reason we buy macbooks is because they aren't touchscreens.

t1234syesterday at 8:13 PM

Is there a coating you can apply to the glass to help with smudge marks?

show 1 reply
ForOldHackyesterday at 8:51 PM

I think I could do this for less than 15 cents: four small peices of double sided tape, and the tiny mirror, and two hair pins... but the software? Priceless.

egypturnashyesterday at 8:28 PM

I wonder how well this would work with my bright blue fingernails that are about .5" longer than my finger.

I then wonder how much recalibration I would have to do when one of them broke and I was poking directly at the screen.

show 2 replies
vjay15today at 7:41 AM

sooo clever

anandkulkarniyesterday at 8:19 PM

Brilliant!

brcmthrowawayyesterday at 8:30 PM

Checking this profile of a random hacker in 2018, of course they are now working on AI.

show 1 reply
lumpotoday at 7:51 AM

[dead]

us321yesterday at 8:25 PM

[dead]

mlvljryesterday at 9:53 PM

[dead]

DeathArrowtoday at 5:38 AM

[dead]

rox_kdyesterday at 9:31 PM

Neeeeveeeer!!! please let macbooks be as they are .. why would I ever choose to put fingers on that beautful screen ... I don't get it!

show 1 reply
als0yesterday at 8:11 PM

Still an amazing hack today and I love it. However, I heard Apple are developing a touch screen MacBook this year, and I simply don't get why they're doing that. I don't know what's worse, the ergonomics or the fingerprints.

show 2 replies