alt Hacker NewsAm I the only one to feel sad that the name means "Enhanced Representation through kNowledge IntEgration", rather than being a homage to a very famous 1950s random number generator?
Replies
cubefox • today at 10:56 AM
It's a homage to BERT (Bidirectional Encoder Representations from Transformers), Google's influential 2018 Transformer model that wasn't autoregressive. https://arxiv.org/abs/1810.04805v2
For me I see ERNIE as BERT's long time friend and room mate.
How do I look Ernie? ... with your eyes, Bert.