logoalt Hacker News

zild3dtoday at 9:52 AM1 replyview on HN

I think you'd want to remove e.g. knowledge of harry potter universe and ancient egypt. Training on a bunch of high quality java code bases is still likely to improve your python model.


Replies

satvikpendemtoday at 11:11 AM

Actually, it's shown that even general knowledge helps coding models because their input is natural language itself so they need to understand it well enough to even turn into code.