Preselect the time unit in Manual tracking to allow for quicker entry.
I'd prefer to have 'hours' preselected because I never track time using any other unit. Then I can simply write a number and hit enter. "2" + "Enter" = 2 hours tracked. No need for letters. No need to select the popup "2 hours" after you've typed in "2h".
The preselected time unit would be the unit you used the last time you tracked time.