Oak, sumac, PI, it doesn't matter. It's the same substance that cause the allergic reaction, urushiol.
Many immune people do eventually become allergic. I was immune to poison ivy until I was in my mid 20's. I could roll naked in the stuff and not have a reaction. Then one day...
Oh the visual image......