Antarctica was still little known, but penguins were already familiar to the world because they are present in Argentina and Chile in regions already colonized and transited through. As the other poster said, Lovecraft could have seen stuffed specimens and drawings and photographs.
The first zoo penguin, a king penguin from the Falkland Islands, arrived in England and was put on display in 1865. Lovecraft very much could've seen a live specimen.
https://www.londonzoo.org/zoo-stories/blog/penguins-through-...