It is strange that if you miss clicked and invited user as a guest or if you like to change him into view only guest, there is no shortcut for that, you should remove user and re-invite it as view only guest, this is the only way.