Is it just me, or do political signs in shared neighbourhood spaces feel divisive and ugly?

I politely asked in our online group whether we could keep them to people’s own gardens. A neighbour told me to take the post down so I wouldn’t offend the person who put them up.

It felt like he was saying it was fine for me to be offended, but not fine for me to offend the person who offended me. Was I being unreasonable?