logoalt Hacker News

vessenestoday at 1:45 AM0 repliesview on HN

Introspection: all heard. As a practical matter, you can rl or prompt inject information about the model into context and most major models do this, not least I expect because they’d like to be able to complain when that output is taken for rl by other model training firms.

I agree that an intermediate non anthropomorphic but still looking at one’s own layers sort of situation isn’t in any architecture I’m aware of right now. I don’t imagine it would add much to a model.

Chip etching: yep. If you’ve never seen an unknown chip analyzed in anger, it’s pretty cool.