Do consider making it possible to add priority later one

[onglijin]

As mentioned in the title, else otherwise, we have to delete and add the person again which might be troublesome.