I have been having this same problem.
Strangely enough the solution is simple, though, for some reason i didn't think of it till weeks later
Completely remove the person from the group and when you re add them, make sure that you do it directly into the owners group
But yes, be sure you really want to do it. You cannot remove them from the group