In the same app, if you go down Settings -> Advanced -> scroll to the bottom -> Export Telegram data, there is an option to export all chats at once, including some very handy controls like getting only your own messages for large group chats.