They sound exactly the same to me.
Wiktionary gives <should've> as /ˈʃʊdəv/, unstressed <have> as /(h)əv/ and unstressed <of> as /əv/.
one is v the other is f
one is v the other is f