I find it very difficult to believe that Lovecraft had not at least seen a photograph or drawing of a penguin, having lived through the heroic age of polar exploration when popular culture was filled with stories set in Antarctica. Even a taxidermied specimen would have been easily available to him in the average natural history museum.