I don't think it comes down to that at all.
Take any male celebrity. Justin Bieber for example. If they showed him as much as they show Taylor Swift, the negative feedback would be the same.
People are picky about NFL games. Watching football is a religion to a lot of people. We complain about every detail of the game from rule changes, officiating, scheduling, broadcasts, commercials, interviews, etc.
Yet, for whatever reason, all that is accepted, but as soon as we complain about Swift we are suddenly hit with the label of being a hater, or misogynist, or insecure, or whatever.