Definitely see where you might feel so. I provided an analogy that may help anchor - why ML fails extrapolation is left as an exercise to the determined reader! :)

The surface for "interpolation" is fairly broad for LLMs but it isn't infinite -- extrapolation still exists!