It would have to be handled by the repository owner(e.g. PyPI) similar to how quarantines are done.