I recently “fixed” my bash history since the default experience when using multiple terminals sucks.
https://dandavis.dev/the-bash-history-i-always-wanted.html
I also use fzf to search my history I believe you just need so source the right keybindings file to make ctrl+r use fzf.
Have you tried http://atuin.sh