logoalt Hacker News

Researchers track whole body movement with just a smartwatch

197 points • by PaulHoule • last Friday at 5:29 PM • 71 comments • view on HN

Comments

kostarelo • yesterday at 1:41 PM

When I put my amazfit helios strap to record a workout of type Strength, it automatically tries to detect the movements I'm doing and figure out what muscles I'm working out. It actually works, not 100%, but it works. It tracks my pull ups, my push ups, my dips, really good. I was wondering how they do it but didn't look more into it.

I'm sure other watches/trackers do that as well. It's really impressive what we can do with just a watch.

➕ show 5 replies
thih9 • yesterday at 9:16 AM

If you own an iPhone, go to Health app and scroll through your mobility stats. You'll find step length, double support time, walking asymmetry, etc.

Apple released a document in 2022 where they documented these features[1], along with details on how they work. I guess next versions will have more accuracy.

[1]: https://www.apple.com/healthcare/docs/site/Measuring_Walking... (PDF)

➕ show 2 replies
amelius • yesterday at 10:14 AM

Note: ultrasound for humans is not necessarily ultrasound for pets.

➕ show 2 replies
guzik • yesterday at 4:10 PM

cool but also I'm a bit skeptical of ~whole body in the title. This article mentions tracking joints down to the ankles but I don't see how well it actually tracks the legs when they move independently of the upper body. What happens if you sit still and move one leg, or do a squat with your knees coming inward? Would it pick that up, or give you something closer to the squat it expects?

ive worked on a related problem, counting reps from a single chest sensor [1]. We covered 12 exercises and released the dataset on huggingface, but even avoiding false counts from movement between exercises took work. We also assumed we knew which exercise someone was doing.

anyways super curious what the acoustic signal adds when there's barely any chest or wrist movement.

[1] https://www.mdpi.com/1424-8220/24/12/3891

➕ show 2 replies
_bent • yesterday at 12:33 PM

(How) would this handle multiple people using the same system being in vicinity (e.g. in the gym)? Wouldn't the speakers talk over each other?

➕ show 1 reply
qzervaas • yesterday at 12:48 PM

Not quite to the same level, but I've recently been working on something similar with my rowing app [1].

The most common use-case is to get rowing data directly from a PM5 or FTMS rower using Bluetooth, but if you don't have a smart rower it uses Apple Watch motion to detect your strokes / stroke rate.

It detects peaks on the pull, then ignores the recovery so it doesn't detect it as a second stroke.

It adapts to how hard you're pulling as you go, so it picks up your strokes within the first few without any setup.

Overall this works well for rowing, but obviously can't accurately work out distance / power etc.

[1] Streaks Strokes: https://strokesrowing.com

➕ show 2 replies
FemTech_AI • yesterday at 11:09 AM

Such an interesting direction, especially for older adults. I hope I live to see the day when devices like this can genuinely help our aging parents stay active and exercise safely, even in remote areas where access to a qualified trainer is limited.

➕ show 1 reply
diimdeep • yesterday at 9:52 AM

Not passive, noise pollution.

    Specifically, the left speaker transmits C-FMCW chirps sweeping from 18kHz to 21 kHz, while the right speaker transmits in the range of 21.5 kHz to 24.5 kHz. Each speaker transmitsC-FMCW chirps with  = 600 samples per chirp. With a 50 kHz sampling rate, the sweep period for each chirpis 600/50000 = 0.012 sec (12 milliseconds). Assuming a speed of sound of 343 m/s at room temperature (20◦C),and following the formula provided in 2, the resolution of the EchoMotion sensing system is approximately 0.343cm (or 3.43 mm), and the sensing range is about 205.8 cm (approximately 2 m).
https://dl.acm.org/doi/epdf/10.1145/3832001
➕ show 2 replies
sameDiff • yesterday at 12:34 PM

How does this work when there are multiple in the room? Does each device have its own signature so it will detect only its "waves"?

bzmrgonz • yesterday at 2:51 PM

Does it work on a bed? horizontal position? This would have major functionality in hospitals.

➕ show 1 reply
elchief • yesterday at 5:23 PM

would this work while swimming?

it'd be cool to track my swimming form just from the watch :)

➕ show 1 reply
diamondDrill • yesterday at 4:49 PM

next level surveillance

➕ show 1 reply
amelius • yesterday at 10:13 AM

Perhaps we can now finally have a way to measure respiratory rate using a smartwatch.

➕ show 2 replies
catskul2 • yesterday at 4:22 PM

Ok, but can we talk about that grey body model visual...

Both unnecessarily detailed, and yet simultaneously not.

pepperoni_pizza • yesterday at 3:08 PM

Meanwhile my smart/sportswatch sometimes thinks I'm asleep while I'm up and walking around.

SilentM68 • yesterday at 7:02 PM

Hmm, so does that mean if an AI LLM is trained in everything kinesiology, human body movement, anatomy, physiology, and biomechanics using this device's capabilities, it can act as an ultra physical therapist or even go as far as a physician that will actually cure their patients just by "watching" a human walk. Pun intended :)

totetsu • yesterday at 8:56 AM

So its taking accelerometer data from a watch, and using it to predict body position with a model trained on whole body motion as measured by ultrasound. neat.

➕ show 1 reply
shevy-java • yesterday at 12:25 PM

It's quite interesting in that tiny devices are almost like ... average computers in the 1990s era. Or even better than that, now.

➕ show 1 reply
faangguyindia • yesterday at 4:35 PM

[dead]

ryansethi13555 • yesterday at 7:54 PM

[flagged]

imposter • yesterday at 9:24 AM

[dead]

madduci • yesterday at 11:08 AM

I.mean, follows the same principle of a Nintendo Switch/Wii controller? Games like Just Dance require certain movements and these are tracked with the Joycons

➕ show 3 replies
kittikitti • yesterday at 1:51 PM

I know this is an unpopular opinion, but this is bad for privacy especially in the hands of Big Tech.