same experience here. I had similar hitting the wall problem in early afternoon. After stopping caffeine it's exactly as you describe