I also suffer from this! But it's called growth. You will not improve language skills if you are too afraid to practice them

And in my experience, us Brits, and USA folk, we tend to be quite understanding of broken English