Registry changes do not always save

Using the web-server to edit registry keys, if I add a new key and restart the server, the key remains. 
If I delete a key and restart, the key is no longer deleted.
If I edit a key and restart, the key is no longer edited.

Is there another way to edit the Registry? What is happening here?
