Specifically, there's alot more of it used. Also using tunnel compression would add even more latancy yet.
That would explain the ~100 ping on games like Supreme Commander when I played with 2 of my friends ...

Without VPN it was a bit better (~60-80 ping). Didn't think that compression will add so much latency. Glad you don't feel it on remote desktops.
EDIT: Actual ping command returns me a ping of 80ms on a VPN connection. Funnily though it has the same response times when using no VPN connection and hitting the ext. interface directly. I am guessing adding more data will stress the connection way more than just a single ICMP packet ...

Supreme Commander can run relatively smoothly/well with 400-500 ping. It's an RTS that doesn't have a strong focus on clicks-per-minute so you don't need lightning quick reflexes or ping to get it done.
I've played games perfectly fine with over 300 or so ping from everyone on SupCom.
Connection problems start to occur higher than that, and late game might be bottlenecked by the lower ping when alot of units are flying around on games with plenty of players.