A friend did something that unlocked bad memories of playing board games

So, when I was younger and had to play with my bullies board games what they will do is everytime I play or do a move they will call me stupid or say you could do x instead and laughing.. I told him about that and he apologised but I know he doesn’t mean in a mean way but I don’t know why it got to me so much