logoalt Hacker News

Midjourney Medical

1325 pointsby ricochet11yesterday at 1:59 AM858 commentsview on HN

https://www.midjourney.com/medical

Video: https://x.com/midjourney/status/2067422898407837797


Comments

jmhmdyesterday at 12:43 PM

Some initial thoughts as a practicing radiologist:

- This looks really cool and I hope they keep innovating on this. I love seeing new modalities develop and despite my (many) reservations and criticisms, if even one good use case comes out of it that truly helps people, it's tech money well spent imo.

- They show the reconstructed images as though they are a low resolution CT, and promise that quality will improve as they iterate. This is cool, but ultrasound is not CT. Ultrasound cannot image the lungs, as they are filled with air. You cannot find bone lesions, as the sound waves do not penetrate the cortex. You cannot image many structures in the abdomen if they are surrounded by gas-filled bowel. The brain is encased in bone, so you might get some penetration but it will be very limited. Even with theoretically perfect AI reconstruction, these scans will not be true "full body" in that there will be structures that are not reliably imaged. Imagine paying for weekly full body scans for years, everything looks fine, then its the lung cancer surrounded by air and invisible to ultrasound that kills you (that's why we use CT for lung screening!)

- The images they show are very cool, and do appear to show the correct structures. I realize this is early, but fuzzy shapes of organs is very, very far from medically useful. The whole point of screening is to identify problems early, often by definition, small. This technology looks like it will be best for seeing large, superficial (close to the skin) structures, whereas for effective screening, you want the opposite - small, deep structures.

- "Incidentalomas" or unexpected, probably benign, findings are annoying to physicians, but I in general have no problem with people collecting data on themselves where they can. To me it's similar to heart rate monitors or home blood pressure cuffs. The main issue here is education, so that patients know what the data is and is not telling them. The more complex the data, the more difficult that is.

- Many people mistakenly believe that early diagnosis is the final boss in medicine, that if only we could find every cancer early we could prevent all those deaths. There are, in fact, many, many other hurdles and bottlenecks. Many chronic, expensive diseases do not have clear imaging manifestations. The claim that "it's completely possible that with enough early imaging in the future, the world could avoid 30% of all deaths and 50% of all healthcare costs", I think, to any practicing physician, would sound completely divorced from reality.

show 12 replies
tmhrtlyyesterday at 10:50 AM

> You want as much data as you can get about your health as quickly and as cheaply as possible. In other words, you want a technology optimized for getting as many “megabytes per second per dollar” of information about your body.

This is so far from my vision of what I want from healthcare. I want a healthcare system that is optimised around A) proactively keeping me healthy, and B) reactively helping get back to healthy when I am not. I do not care about the amount of megabytes of data I have about my body.

show 13 replies
keiferskiyesterday at 6:00 AM

I have a mixed response:

1. It kind of makes sense that an AI imagery company would apply that to other novel applications of imagery and computing and try to do something cool with it.

2. Midjourney as a brand is all over the place and this feels -off, somehow. I think from a branding pov they should have just started a different company with a different name. Perhaps a single image-focused umbrella company named [Name] with Midjourney and this medtech company as separate subsidiaries.

3. AI imagery companies suddenly making medtech products and spas feels very “we don’t know what to do, so we’re going to throw spaghetti at the wall.” That doesn’t necessarily mean it’ll be bad, just that it’s not typically what you’d do if you’re working on something super successful already.

4. AFAIK they are entirely self-funded and so this really isn’t about VC scaling or anything like that. But that doesn’t mean they’re immune to the same cultural pressures.

show 9 replies
mNovakyesterday at 4:28 AM

This is really interesting! And perhaps surprisingly doesn't trigger any immediate major technical red flags (as someone who has worked with MRI and phased array beamforming), as many HN HW articles do.

My only criticism from the tech video would be that they spend some time lauding the nanometer deflection sensitivity, which might lead some to believe that's indicative of the image resolution. It's not, and it's somewhat of a distraction -- that's just giving us amplitude information, which is comparatively less important than correlated time/phase across the 100k sensors. They do later on state ~mm resolution, which is still great!

Doppler and motion blur may be an issue (e.g. heart beating), as one slice requires a full ring of sequential exposures. But still way faster than MRI, so probably fine.

On a lighter note, it could seriously change the meaning of get FUCT (Full body Ultrasound Computational Tomography)!

show 2 replies
GTPyesterday at 10:39 AM

I find the technology side intriguing and worth a deeper dive.

But I'm not convinced about their view of having people casually going to a spa every week and getting a full body scan. AFAIK, some doctors tend to avoid full-body scans. The reason is that each body is different and has its own quirks. If you do a scan for no reason other than "I can do it fast", chances are that the scan will show something unusual. But, at the same time, it is likely that it isn't a problem. And now, you will be stressed about the chance of having some health condition and spend time and money digging into a rabbit hole of what the issue could be, only to find out it was nothing.

They also don't say anything about the price of such a machine. If they really envision a future where everyone can easily get a scan, this is a crucial factor.

show 13 replies
randusernameyesterday at 11:53 AM

> Beyond that, regulation is the next limit. Normally, for every diagnostic medical capability you need FDA approval. We’re starting by just giving you detailed body composition maps — and we’ll be submitting regular test results to the FDA for increased capabilities.

This is just not how the FDA works. At all. You can't just email them slideware and marketing materials to keep them in the loop.

You have to hire an army of expensive compliance people (cheap ones aren't nimble enough for startups), develop the whole thing start to finish under strict design controls, and usually throw a lot of time and capital into convincing regulators your very innovative and disruptive new R&D endeavor is actually derivative enough to draft behind some existing medical device.

show 4 replies
unholinessyesterday at 2:53 AM

So, on the one hand, this is interesting! Reducing radiation from CT scans is a noble cause on its own. If on top of that it could make tomography cheaper and easier, you could imagine getting earlier detection of aneurisms, fibrosis, cirrhosis, thrombosis, stenosis, even plausibly cancerous masses (along with plenty of over-detection).

On the other hand, nothing here substantiates this promise. We've got a video render of what a hypothetical device could look like. It's probably more than nothing (they got exclusive license on these butterfly chips in 2025, and it's at least plausible that the best solution to the data bottleneck in an absurdly noisy system like this is real-time AI image processing)... But it's certainly less than something. It's a hype video that doesn't prove feasibility of anything, yet.

EDIT: This is all in reaction to the second video on the announcement post[0], which is much more informative than anything on the page currently linked.

[0]https://www.midjourney.com/medical/blogpost

show 6 replies
haldujaiyesterday at 5:29 AM

This is ridiculously optimistic. The technology, USCT with full waveform inversion, is not new.

It’s already used in breast imaging (SoftVue) and hasn’t replace mammography. A body part ideally suited for ultrasound.

More compute many minimize some of the fundamental limits of sound waves (bone and gas) but I would be shocked if they have useful images of 90% of the body parts we image with CT or MRI and even beyond that I question how much it’s more useful than B-mode anyway.

Quite slow which means most things abdomen and chest will be motion degraded.

This may be useful in superficial areas but then why do whole body anyway. Might be some new niches and interesting research but hardly revolutionary in my opinion.

show 1 reply
iDonyesterday at 10:07 AM

> ... It starts by stepping into a shallow pool of golden light. > ... Together they act as both a choir and an audience

I think I'm not the target audience. I guess they are going to need to sign up a lot of people, to train on their scans + their medical outcomes. So the article is talking to people who will get enthused by it, which is more difficult after the question of 23AndMe data sale.

show 1 reply
Aurornisyesterday at 3:08 AM

> enough to give regular, monthly scans to a billion people.

There is a part of me that thinks it would be cool to get cheap full body scans. I like being able to see inside of myself. I can think of a lot of situations where the low-fidelity images coming out of this (they're not good compared to real medical imaging, if you've ever looking at MRI/CT up close) could be useful for coarse analysis of certain conditions that come and go or need to be monitored over long periods of time.

What I don't like is the idea of getting people to do full body scans every month just to be safe. This might sound like a good idea if you haven't looked at the literature on preventative full body imaging. Looking for bad things inside the body sounds like a great idea on the surface.

The problem is that imaging, especially when it's as rough as these ultrasounds, and possibly worse when augmented by AI guessing at what it's seeing, can lead to a lot of unnecessary procedures. The net effect can even become more harmful than the number of real problems it catches. There's a long history of research on this as many companies have tried to commercialize full-body scanning in the past. It frequently leads to situations where there's an unknown or ambiguous spot on the imaging that the person reading the scan can't rule out, which turns into a lot of anxiety and eventually more imaging, biopsies, or unnecessary surgeries. It's easy to think "better safe than sorry" until you realize how often these benign but ambiguous findings show up on full body imaging.

So my initial thoughts on this are that it would be good to make cheap ultrasonic imaging accessible as an as-needed service to use for specific conditions. I do not think it's a good idea to go down the road of trying to scan the entire population once a month and then run it through AI to see if anything pops up. The number of false positives would be overwhelming and lead to a lot of unnecessary procedures to calm the resulting anxieties.

show 3 replies
tgsovlerkhgselyesterday at 4:11 AM

I think a lot of medical diagnosis could be solved with mass data collection if it was cheap enough. Right now, blood draws are somewhat routinely done because they provide a lot of human-interpretable indicators from a small number of values, and there is some evidence that e.g. "dogs can smell cancer" etc. (i.e. some diseases cause detectable odors).

With a big enough data set of [all kinds of bio values, including ones considered irrelevant for that disease] labeled with diagnoses, I suspect we could get very fast and accurate automatic diagnoses, even from a limited data set currently considered uncorrelated. Rather than going to your primary care physician, you'd go into the standardized, mass-produced and thus reasonably cheap everything-scanner, and you could likely get a more accurate diagnosis (or at least "things to check") than the average doctor would be able to give you under the practical constraints they typically operate under (time, available information/diagnostics).

This goes in that direction, and I'm really excited to see where it goes. I could imagine that given enough training data, ML models will be able to pick up on minute details that make it possible to diagnose diseases that weren't historically considered ultrasound-diagnoseable from this kind of detailed ultrasound.

I think combining it with gas chromatography/mass spectrometry of e.g. breath or blood/sweat/urine samples would also have the potential to be a cost-effective diagnosis method - lots of data, probably not all too useful for human interpretation, but would open the potential to walk up to a machine, breathe into it, spit into it, pee into it, give it a swab, and have it come up with an accurate diagnosis without invasive testing. If mass produced, the cost of something like this could easily drop below the cost of a typical doctor's visit. (I googled it and it seems like GCMS is already used for some diagnoses, but screening only for a few specific diseases rather than "throw ML at it and try to diagnose everything").

show 14 replies
sberensyesterday at 2:38 AM

I don't understand how people can hate on this. It's probably the most novel & ambitious consumer health device ever? Plus they're doing it fully bootstrapped. Let them cook!

show 12 replies
owenthejumperyesterday at 11:26 AM

Almost nobody here is a doctor, and it shows...over diagnosis, over treatment, those are all terms that doctors learn about in medical school.

Image segmentation is a real problem, and achieving better precision is a good goal. The "golden" standard these days is likely https://github.com/wasserth/totalsegmentator, if someone can make it even more accurate, that would be very very good. But yet again, there are infinite amounts of variations in human bodies, which means even the best models focus only on segmenting known organs, and leave anything unknown alone.

show 6 replies
Jabrovyesterday at 3:03 AM

They've lost the plot, especially with the spa. And a billion scans a month is absurd.

Is this some AI hallucination post?

show 6 replies
maz1byesterday at 2:44 AM

I had to check the date after seeing the headline, and again after opening the page. Thought it was April Fools.

Regardless, as a doctor and full stack engineer, I'm looking forward to learning more about their methodologies, their approaches, but I don't think this is going to be displacing MRIs or remotely close, based off the cursory initial glance. If their vision is to be able to provide end users with more actionable data with some kind of "low fidelity" medical imaging data that is somewhere above zero and or standard imaging and high fidelity modalities like CT/MRI, then this could be somewhat interesting.

Not a radiologist and not medical advice. Just my two cents.

show 3 replies
handwovenyesterday at 3:37 AM

Gives me the strange impression of a product that was vibe-brainstormed, vibe-engineered, and vibe-announced.

show 2 replies
arrelyesterday at 6:10 AM

This is an ambitious idea, but it’s pretty misleading to lump MRI, CT, and ultrasound into a single “body scan” category. They do different things and explicitly do not serve as replacements for each other.

Inventing new, affordable early detection devices is incredible, but being so misleading in their positioning is going to kill long-term trust in this and other new scanning tech.

amirhirschyesterday at 2:48 AM

There are 100M pregnant women right now. If it works for just for the vanity use of seeing your baby grow (forget the medical imaging aspect) and can be as casual and relaxing experience as they put forward, then I can see such a spa being wildly successful.

show 1 reply
armcatyesterday at 6:12 AM

Neko Health has been doing this now for a few years. What I heard is that ultimately it doesn’t solve much (other than them privately collecting all your data) because there are lot of false positives and these false positives are deferred to the general healthcare system, which is a major bottleneck.

cglanyesterday at 2:24 AM

First of all, this is incredible. Like genuinely insane. Also I bet you can do crazy things with that tranducer. If stuff like this keeps coming out, we have nowhere near enough compute

themantalopeyesterday at 2:33 AM

radiologist here - example images don't look great

show 6 replies
tfirstyesterday at 2:31 AM

It's obvious why they're doing this: there's a lot of money in healthcare.

What there isn't is good evidence that these full body scans actually improve outcomes.

show 1 reply
otaviogoodyesterday at 6:54 AM

FWIW, I tried the prototype. It's very real. I scanned my hand and arm. It showed realtime images of slices of my hand as I dipped my hand in the water. Really amazing IMO. I think this will be a game changer when it comes out. It's just so easy to scan yourself.

show 1 reply
captainblandyesterday at 5:20 AM

I think it's a bit odd to compare this to an MRI. The physics are totally different and there are things it fundamentally won't image in the same way because it's basically just ultrasound.

The approach sounds like something which appears in a few research articles from the 2010s (ultrasound computed tomography), although submersion to make the ultrasound transmission more efficient seems novel.

It's possible the "spa" approach is used because it's hard to achieve the level of cleanliness required in a typical health facility using a shared bath.

show 1 reply
atkristayesterday at 5:49 AM

Companies are awfully confident of advertising "revolutionary" ideas that don't even have a testable prototype. I too have a dream of world peace and eternal human prosperity that I would like to sell. Any interested investors?

show 1 reply
lifeisstillgoodyesterday at 7:52 AM

In the early years of X-rays, doctors found all sorts of patients with major organ displacement, and performed surgery to, for example, hold the liver or kidneys “up”.

It took a while to realise that textbooks since Leonardos time had drawn and based anatomy on (dead) patients lying on a slab. But X-rays were taken with (alive) patients standing up. So of course there was a lot of “your kidney has slipped!”

I fully support and applaud this kind of medical innovation (even if … why midjourney?) but we need to be careful of the medical term VOMIT (victim of modern imaging technology). At some point we need a human doctor to say “calm down, live your life, eat right, exercise right, and accept that somethings don’t need to be panicked over yet - come back in six months”

cseleborgyesterday at 2:12 PM

> You want as much data as you can get about your health

The device looks very cool, but I strongly disagree with the premise, and think this statement is rather misguided.

1. Most people who feel unhealthy don't do so because of a lack of data but because of bad habits around meals, exercise, sleep, social interactions etc.

2. If you measure and scan all the time, every blip above or below the normal curve will start generating anxiety. One of the most frequent pieces of advice for people waking up in the middle of the night is to not look at the clock. Information can be stressful.

teekertyesterday at 6:55 AM

A problem with large scale "screening" is the explosion of false positives (even at very high specificity) and the follow-ups that those generate will overwhelm our current healthcare systems.

So any machine that does something medical must address this. Either that, or don't be medical. But then you might just as well tell people: "Move around a bit more. Talk to other people. Eat real food, not too much, mostly plants."

But we are always attracted to solutions that fix us in easy ways. The problem is that the issues are often with our behaviours, and those are hard to change. Or perhaps we are finding easy ways now with GLP-1 agonists and our future health and happiness is in drugs... But then why do we need this machine...

show 1 reply
nooberminyesterday at 2:29 AM

Clearly something like this would need to be approved by the FDA, it is literally irresponsible to promote something like this as being more powerful than a MRI.

show 1 reply
block_daggeryesterday at 2:35 AM

I watched the whole video thinking it was generated by Midjourney, the product, and that the announcement was related to fidelity in images/video around human anatomy. This seems like a very strange pivot for them indeed.

show 1 reply
schmorptronyesterday at 7:11 AM

I'm giving them the benefit of the doubt and interpreting it in a charitable way because they sound earnest about it, this is incredibly ambitious and cool-sounding, and I wish them all the best. It's something that's some sort of pipe dream, a noninvasive diagnosis machine that is able to use certain generic measurements and then derive insane levels of data from it. We've of course seen Theranos, but the holy grail remains.

Of course, there's always the tradeoff between research data collection and access vs user privacy, and striking that balance is incredibly hard. To make anything like this even remotely feasible you'll need a shitton of data and have it fully available to your researchers as well, while somehow safeguarding individual users. anonymizing medical data is impossible without rendering it near useless. Hoping they can figure that out! (Also, with human bodies being so different from one another, combatting bias is probably an eternal challenge)

shireboyyesterday at 10:45 AM

I have thought that extremely accessible, portable, non-radiation imaging would be revolutionary. Imagine every doctor - or even every person - had a handheld thing they could wave over your affected area to get a high res 3d image of the issue. Of course we have mri, xray, and ultrasound, but those are big and expensive. Obviously there are engineering reasons that is the case, but It seems like a concerted effort to make imaging more portable and accessible, coupled with ai to help analyze could bring about all sorts of follow-on health improvements. Your regular practitioner could check you for heart blockages, clots that lead to stroke, cancers etc as a matter of course. I’m not sure stepping into a golden vat of water is what I have in mind but medical imaging does seem like a possible area for drastic innovation.

show 1 reply
dwdyesterday at 3:35 AM

That video gave me ESB Han Solo carbon freeze vibes. Not sure if that was the stylistic intent they were going for. I guess there's a good chance those who worked on the video weren't even born when it was released.

verandaguyyesterday at 2:17 AM

I'm sorry, a billion full-body scans a month?

For what possible reasons? Are people going to be doing these things recreationally? Cause otherwise you're talking about scanning the entire world's population, including the very young, the very old, the mobility-impaired, and those without easy access to US-based facilities (i.e.... people who are part of the small fraction of the global population who do not live in the US), twice over, every 18 months.

What possible use could there be for doing this?

I recognize that the presser says the scanners will be deployed "around the world," but let's be real, this will probably be 80% US.

show 8 replies
chhxdjsjyesterday at 3:37 AM

Looks like an array of ultrasound probes which is fine.. how does this deal with bone obstructing windows? the example with an abdo is feasible and fine but you cant do that with brain or easily with heart /lungs

niruiyesterday at 7:03 AM

I watched the video first without reading the text and thought, wow, Midjourney has gotten really good, they generated debris in the water exactly like what would happen in real life if the water is reused enough.

Then I started reading the text, and realize it's not an ad for their video generating tool? Cool if each of it can do ~120000 scans per-month. But if I have to step in to a tank filled with debris and discharges from ~3,999 other people (assuming the machine is maintained daily), I think I might have to wear protection and you must not lower me beyond my mouth.

But, if the claim is real, then yea, it could really help. So many health problems can be discovered early with ultrasound scan, only if it can be made easy, cheap and fast. Not sure about resolution and other specs, if it can be as good as CT, then more lives can be saved.

show 1 reply
andaiyesterday at 1:03 PM

Super cool. Reminds me of Mary Lou Jepsen's (who did One Laptop Per Child) company Openwater, which is using some kinda infrared holography, also as an alternative to MRIs.

Supposedly they can be made lightweight and wearable.

https://www.ted.com/talks/mary_lou_jepsen_how_we_can_use_lig...

https://en.wikipedia.org/wiki/Mary_Lou_Jepsen#Openwater

AbstractH24yesterday at 10:41 AM

April fools 2027 is gonna be nuts

We live in an era where the daily news stories are so crazy topping them is going to take some creativity

Reubendyesterday at 2:22 AM

I don't really understand the connection; they went from image generation to medical scanning?

show 3 replies
alexcpnyesterday at 8:08 AM

After reading this first, it looked almost like a joke, like how Google used to do Google- TISP Toilet Internet Service Provider https://archive.google/tisp/install.html

Even now without Xrays it is very hard to really even see if there are blocks in your artery usuing ultrasound (Echocardiography alone). Ultrasound is used indirectly by measuring blood flow difference between stress and rest - not a spa session anyway. Looks like a prank really

show 1 reply
elAhmoyesterday at 12:38 PM

Not sure why people keep posting links to X videos when they are available from at the official announcement post: https://www.midjourney.com/medical/blogpost

World's first trillionaire doesn't need more money or influence in destroying people lives, let's do a small step at a time and not use X.

uberexyesterday at 4:54 AM

This is a full body ultrasound?

Medical I don't care about futuristic sounding stuff. Just show me evidence based and clinically useful testing.

Use AI and new scans to help sure but prove it works otherwise this could be another dead end.

inasioyesterday at 5:37 AM

I've worked optimizing MRIs trying to make them faster and more accurate, they're amazing machines (distinguish white matter from grey matter in the brain is very non trivial), but super complicated and expensive. To me, the paradigm change that could come from greater accessibility and throughput to analyze all that data would be having longitudinal baselines (scans every x months), which right now only very few people can access, and for the same reason there's not a lot of data to build accurate models.

jablongoyesterday at 3:54 AM

This is very ambitious and commendable. They are putting their bootstrapped money into something incredibly cool and potentially useful. Regulatory will be hard, but perhaps they can do something like a class 1 device which doesn't diagnose anything / is used by physical therapists and they sell them to gyms. I also expect the resolution to increase rapidly. If they can convert profits from generating weird ai images into new medical technology thats a win. Good luck! They will probably fail but this is what ambition looks like!

Yokohiiiyesterday at 12:36 PM

Interesting choice to draw "inspiration" from the chambers of Niander Wallace, the main antagonist in Blade Runner 2049.

https://architectureofsilence.wordpress.com/2018/02/13/archi...

taninyesterday at 2:26 AM

I had to check whether this was some kind of an april fool joke.

It looks like a legit attempt. Wow. This is insanely innovative.

consumer451today at 6:07 AM

I have zero medical knowledge, but assuming that they go through a good regulatory approval process, why is everyone so negative?

These are smart people trying something new. They are bootstrapped.

How is that not cool? Isn't this exactly the type of thing that should be exciting?

🔗 View 50 more comments