AITA for refusing to attend any Super Bowl parties?

I'm fully prepared to be named the problem here, but I'm just curious. I am a massive Eagles fan. I'm talking tattoo, bleed green, cried when they lost the last Super Bowl fan. My fiancé has always said he loved this about me, because he enjoys that I love the sport too, and we have fun rivaling each other when our teams play (he's a Niner's fan). However, he knows that I am not fun to watch games with - it's just a reality. I'm loud, I scream every play, and I'm a typical Eagles fan with the trash mouth. Again, he has always found this amusing, but insists we should watch at home to avoid public scenes (fine by me!). This all changed yesterday when he said we were going to his family's house to watch the Super Bowl. Ordinarily we do go watch with family, however, it's because my team isn't playing. I assumed since my team is in this year, that we would stay home for all of the reasons I just mentioned. When I said I was probably going to stay home because I don't want to make everyone feel uncomfortable, he got irritated and said that I should just "rein it in". He insists that I should go, because it would be weird for me not to show up because everyone is excited to watch with me. The thing is, I know I'm not fun when my team plays! I'm usually very fun, sociable, and enjoy spending time with his family. But I swear if one person tries to distract me during this game, I'll snap - and that's not going to change overnight. And the annoying truth is that both my family and his treat me differently when I'm watching football than him. For some reason, the men are left completely alone during the game so they don't miss a second. But I'm always approached to have conversations, or help with a kid, or help with food. And I'm not going to be nice about that this time! Fiancée is now upset and says I'm being selfish because I'm not willing to spend time with him during the game. So... am I the asshole for wanting to stay home alone to watch my team in the Super Bowl?