You dont' have to take anything away, or even make it smaller. If the HUD is aligned in a single row on the bottom it would be perfect, and the playing screen would be bigger as well. This is a great and simple solution.
If it's not possible to have it all in a single row, then have one thing...