logoalt Hacker News

lazideyesterday at 11:38 AM1 replyview on HN

The example given was a ‘lightweight LLM’ by the poster, which sounded an awful lot like client side?

If server side, you already have the heavyweight stuff going on, and yes there is no need to do all the bypassable shenanigans.


Replies

almosthereyesterday at 5:37 PM

Since that client side llm would be processing billions of messages each year on each person's laptop, lol