logoalt Hacker News

varispeedyesterday at 1:52 PM2 repliesview on HN

Until thumb drives became large enough to fit most datasets it stopped becoming Big Data. Just normal data.


Replies

ffsm8yesterday at 2:46 PM

We have thumb drives that can store petabytes of data?

Or did you mean the "big data" crowd which thought 500GB was noteworthy? I don't think anyone took those serious, neither in 2010s nor now. That was always "small" data

show 3 replies
jmalickiyesterday at 3:14 PM

To some degree IMO big data is still a mindset when it might take a day to process your data in a normal SQL query. Some tech doesn't scale to the data size for all use cases, and you need different solutions.