If you shift right click with an empty hand on a locked chest, it will open it and you can remove items!