alt Hacker NewsA self-hosted, better browser interface to preview s3 files. This overcomes the limitation of the s3 console not allowing querying or viewing files beyond a certain size. It also gives you information about the column types. It could be a good use case to present this to non-IT teams in orgs who just want a preview of the data in the files or want to do some simple explorations. Frequently, they are denied access because of the possibility of doing something with confidential data via the s3 console.
Very cool, it’s insane to me how frustrating the S3 UI is. My current annoyance is bulk downloading is hard, and seeing things like “how large is this bucket or specific key prefix in bytes”
Saw you using DuckDB at internal/handlers/api.go
Wondering if you’d considered letting queries operate at the bucket or key prefix level instead of requiring key to specific file? Or is that already supported?
I’ve liked being able to point DuckDB to a folder following Hive partition scheme, and then querying it just like Spark/Trino would over many files