logoalt Hacker News

Paging Through a Parquet File in DuckDB: File_row_number or Offset?

37 pointsby rustyconovertoday at 2:58 PM3 commentsview on HN

Comments

RobinLtoday at 4:19 PM

There's also a pseudocolumn called rowid that's worth knowing about for similar purposes but on duckdb tables:

https://duckdb.org/docs/lts/sql/statements/select#:~:text=Ro...

matharmintoday at 3:55 PM

I'd assume it's common knowledge that you cannot paginate using OFFSET + LIMIT unless you use ORDER BY on an unique set of columns, no matter what database you're using. The only exception is when the database provides an explicit order guarantee without the ORDER BY, such as the case with `preserve_insertion_order = true` here.

show 1 reply