Never had an actual problem using a Disabled Bay, but did see more than a few scowling ‘lurkers’ when we pulled up in an electric blue Audi TT (we had 2 different kinds in 8 years). Soon drifted away once DH hauled my wheelchair out of the boot. I one case a middle aged couple came over to check out the boot space, impressed a ‘chair could even fit in the boot.
When I’m out by myself it becomes clear as soon as I take the stick out.