logoalt Hacker News

benruttertoday at 8:40 AM1 replyview on HN

This is a great article, I feel like I think of this a lot when I build something new.

The tricky bit I think though, is deciding what actually is boring, since really we should factor complexity in too.

I work a lot with data in python, for in memory data, the most popular choices are:

- pandas - pyspark - polars

Pandas is the most established, although has a lot of technical limitations, as well as complexities.

Pyspark is definitely an "industry standard" choice, but now you're dealing with distributed computing when you probably didn't need too.

Polars is the simplest in terms of API and not being distributed, but then is the newest.

I can easily imagine a discussion where three engineers all agree that they should choose the "most boring" tech, but all choose a different option.


Replies

Cthulhu_today at 9:23 AM

This is where 'boringness' is only one factor in the bigger equation, and you (as a team) should make a list of criteria - familiarity, features, cost, hiring, support/backing, etc.