Actually I think you are right, I just tried again and noticed clicking anywhere but not on the icon has a different action compared to clicking on the icon. So I was slightly wrong but it does seem that because the icon is small means it is easy to actually ‘miss’ it and instead end up with the wrong action.

I have this issue and I believe it is because the icons are very close together on the screen, and it is easy to accidentally press the wrong one.