Use the pointers instead of reference in loaned interfaces

[saikishor]

Earlier we were using the objects directly instead of the pointers, and that means inorder for the controllers to have access the onyl way is to store the reference to that particular variable

However, In the new approach with the pointers, we cannot have the reference to the internal memory of the pointers, it is dangerous as in previous case that the loaned interfaces have access to data without having the ownership, this means if everyone removes this interface, we will have a dangling interface

[christophfroehlich]

LGTM, thanks for adding the explanation why we should change this.

I was just wondering if we should check the use_count when accessing the handle (if there exists even a hardware with it), but I don't know if this is an expensive operation.