Same here, but the GitHub thread actually calls that out as a known bug. Swipe from the left. Intention is that clicking sonewhere on the map closes the dialog.