True--and I have a lot of experience with the IRS--but the IRS is controlled by congress so they're acting out on congress' wishes.
For instance: they don't hesitate to audit your or me, or demand every penny and not a cent less. But if you're a one-percenter, they're hands off.
Point being: they're a symptom, not the problem.