If you catch the eye of a bobby, and if that bobby decides to make something of it, and if a prosecutor decides to press charges, and if a judge decides you had no good cause ...
There's leeway and human judgement all the way through the chain.
This has happened to people, example: https://www.lccsa.org.uk/george-bayliss-v-director-of-public...
He used a knife to cut vinyl floor tiles at work or something, put in his pocket, went to Tesco the next day having forgotten it was still in his pocket, and got prosecuted and convicted.
Unclear what sentence he received, but the process alone is enough of a nuisance already.
Yup, only as soon as the police officer decides they don't like you, they can arrest you. And then they can hold you for 24 hours. And then you've likely missed a day of work (very impactful for some people), or been unable to feed your pet, or pick your kid up from school, and any number of very impactful things.
Every law needs to be balanced against it's possible impact if someone decides to abuse it. And giving officers of the law the ability to do things "because they probably won't" pretty much ALWAYS turns into "oh look, they did".