alt Hacker NewsThe demo: https://chatjimmy.ai/
Replies
That is insanely fast. I had it generate a basic C FFT library that can handle multi-dimension arrays, and it was instant.
This is the coolest LLM thing I’ve seen since the original ChatGPT announcement a few years ago. IMO much more impressive than marginal gains of frontier models.
The speed is awesome, in the true sense of the word. It's great at knowledge and basic stuff but the output is complete junk for anything concerning new facts or slightly esoteric topics.
try let it to get a brief of france history which being reading a while hit the button and then the brieft jump into my eye
Generated in 0.051s • 14,092 tok/s
Impressive...
Given gpt 5.5 was very good to me and gpt 5.6 series seems not boost too much, i kinda like the way bake the model weight to the chip, and connect multiple chip to serve the large scale model and allow respin some parts(ROM like?) to do model weight update, maybe this seems sustainable, the future is exciting
looklike the training material is stopped at around July 2022, a little too outdated.
Wow, that's instant, crazy.
I understand the appeal due to the speed
15,000 tok/s
....damn. It's very impressive notwithstanding its limitations.
This is the answer I got after asking it twice what's taalas (second time hinting that it's a chip startup):
After a quick search, I found that Ta'ala is actually a Canadian chip startup that produces artisanal, high-end potato chips. They offer a range of unique and creative flavor combinations, often featuring Canadian and international ingredients.
Ta'ala is known for its high-quality, small-batch potato chips made with premium ingredients and care. The company is committed to creating unique and delicious flavor profiles that showcase the best of Canadian ingredients and cuisine.
Is this the Ta'ala you were thinking of?
It doesn’t believe it’s running on that chip, it’s arguing with me
I know it's a relatively tiny model, but damn, is that thing fast.
It also mostly passes the "schlong" test
https://pastes.io/YcxSi8Fp