Tens of millions, I'd wager. In the US, probably fewer. Something like 30% of households don't have broadband, even here.
The real problem though is that you lose access to your own games without checking in, despite having already paid for them. Or, years down the road when MS stops supporting the system, it all gets bricked.