There's absolutely no shame in "falling behind" on a podcast when even the audio itself is subpar, your time and attention is way more valuable than that. If the hosts have problems with that, they can provide sensible extra aids such as high-quality transcripts, to help viewers catch up on what they've missed without placing undue demands on their time.