I ended up buying a new cable that has 90 degree connections (on both ends). The phone sits in the arm rest a lot lower, sideways...
I just run the cable out the passenger side and leave it.
The connection inside also frees up a little more room for other things, like 2 nickels instead of 1.