It means the questions including their answers are dependent. Ie, theres a data generating process for them, that the model uncovers. Like a KNN is known to have near Bayes accuracy as k/n to 0, n to infty, k to infty. The data reveals the dgp.

I suspect if you feed unrelated or even garbage questions into the eval set, it would reduce the performance.