logoalt Hacker News

duskwuffyesterday at 8:54 PM1 replyview on HN

> So if you detect usage of 3-byte encodings, chances are you'll continue encountering only 3-byte encodings, with the odd ASCII or emoji codepoints.

Depends on what kind of text you're processing. Many languages use the ASCII range for spaces/newlines, digits, and punctuation.


Replies

mort96yesterday at 9:03 PM

That, plus markup, be it something XML/HTML-like or something Markdown-like.