If you ever visit Taliesin in Wisconsin (which has a pretty bland), you should also visit the nearby House on the Rock which is a fascinating and very weird collection of esoteric and kitschy items.
The contrast in attitudes and aesthetics between the two is incredibly stark, and it's very interesting to see the reactions of visitors to each location.
This is, by far, one of the weirdest places I've ever visited. Tonal whiplash is an understatement.
Remember that Wright told HotR owner/designer Alex Jordon that he wouldn't hire him to design a chicken coop. You are correct; both should be visited. However, get ready for monotony at HotR. Room after room after room of Jordan's curiosity collection.