logoalt Hacker News

dist-epochyesterday at 7:27 PM2 repliesview on HN

I'm curious if you also laugh at articles about how to reduce your AWS bill, or how to add indices to Postgres such that you can run it on cheaper hardware.


Replies

mhitzayesterday at 11:06 PM

You can generally understand your AWS cloud usage, and waste can be self evident with their existing tools. Not at all with llms.

A postgres index post is unlikely to reach front page. It's already part if the docs, and should include more context to be read worthy.

They are not equal comparison.

This before the fact that there is no guarantee that a model follows your agent instructions (plenty of easy to reach for research on it), and you also get suggestions by devs at these companies to wipe parts of your model's instructions because the model is better now tm.

If cloud providers change their billing quasi monthly, and if you'd need to fiddle with your indexes every couple of days. I'm not sure we'd be using them as much.

There is interesting information about the inference pipeline, but almost too late to the party (by at least a year), and for which audience? Techies understand in broad strokes the tech if they are interested, normies will definitely not read it.

All that to say, that yes, it's worth having a laugh. If for nothing else, as a release valve for all the problems they create in the real non-VC world.

Anthropic is IPOing in October according to news, you might be interested in investing.

show 1 reply
Banditozyesterday at 9:13 PM

I think you're conflating two different things here. I am not aware of any DB optimization articles that say "trust me bro, throw your data, don't build indices, it'll Just Work™!"