logoalt Hacker News

sheeshelast Friday at 1:40 PM2 repliesview on HN

In essence it is a thing that is actually promoting your own brain… seems counter intuitive but that’s how I believe this technology should be used.


Replies

tsunamifurylast Friday at 4:28 PM

This technology (which I had a small part in inventing) was not based on intelligently navigating the information space, it’s fundamentally based on forecasting your own thoughts by weighting your pre-linguistic vectors and feeding them back to you. Attention layers in conjunction of roof later allowed that to be grouped in higher order and scan a wider beam space to reward higher complexity answers.

When trained on chatting (a reflection system on your own thoughts) it mostly just uses a false mental model to pretend to be a desperate intelligence.

Thus the term stochastic parrot (which for many us actually pretty useful)

show 2 replies
sheeshelast Friday at 4:29 PM

Meant to say prompting*