The study and discourse surrounding societal privilege (in any context, of which there are many), does not exist for you to take offense to.
It is simply a way of understanding inequalities and the institutionalization of oppressed groups.
When discussing privilege and social inequality, one is not in the practice of trying to determine which groups have it “better” or “worse” than others.
When discussing privilege, there is no blame-gaming amongst groups of people.
The blame lies with society.
So stop taking it personally.