logoalt Hacker News

tibbar • yesterday at 9:37 PM • 1 reply • view on HN

The issue is that data complexity is also exploding in the age of LLMs, so it still takes a lot of archaeology to get reliable (as opposed to plausible) numbers.

I think this dynamic also requires more data engineers, but I don't personally see the split in demand between those roles that you describe. Data analysts often have business or domain context that data engineers lack.

Perhaps we'll start rolling data analysis work into "operations".


Replies

disgruntledphd2 • today at 6:11 AM

Data is weird because it became very specialized very quickly. We'll still need data people but they'll cover a broader scope than before.

The implications of custom dashboards for every question are huge, but will require a lot of harness and tool building to realize.

The next decade or do will be all about building tools for different domains.