I realised a step up with going to lunch with Japanese friends where the stream of sounds started to become comprehensible as discrete words. When I understood some of them I at least grasped the topic of the conversation, though not the details. It takes time and patience...