Morris Minor Owners Club

Do you think I should try new stems first then

You need to take the head off and evaluate its condition, and that of the bores/pistons.
Until you do that you wont know for sure what the problem is.

Stems = valve shanks = new vlaves, which would be fitted with new guides, and obviously new seals! No - not worth doing. But do pull the pistons and inspect the damage!