He also famously deduced Penguins were Grotesque despite never having seen one.
"On the barren shore, and on the lofty ice barrier in the background, myriads of grotesque penguins squawked and flapped their fins"
This is also in part a reference to Poe, whom Lovecraft idolized. Poe's "The Narrative of Arthur Gordon Pym of Nantucket" included a voyage to Antarctica and featured monstrous penguins (and the call of "Tekeli-li", which Lovecraft also borrowed).
Antarctica was still little known, but penguins were already familiar to the world because they are present in Argentina and Chile in regions already colonized and transited through. As the other poster said, Lovecraft could have seen stuffed specimens and drawings and photographs.
I find it very difficult to believe that Lovecraft had not at least seen a photograph or drawing of a penguin, having lived through the heroic age of polar exploration when popular culture was filled with stories set in Antarctica. Even a taxidermied specimen would have been easily available to him in the average natural history museum.
"Anything that comes out of the South is going to be called grotesque by the northern reader, unless it is grotesque, in which case it is going to be called realistic."
-Flannery O'Connor (on the American South, though it applies to the global south as well)