fix peft cpu ut failure

[yao-matrix]

in to only data of param moved to the specified device, but SCB and CB still keep in the before device, this will lead to peft below ut fail

pytest -rA tests/test_gpu_examples.py::TestLoftQ::test_bloomz_loftq_8bit[cpu]

Since in this code https://github.com/huggingface/peft/blob/main/src/peft/utils/integrations.py#L107, peft will find weight.data has different placement from SCB, so kind of only partial to was done.

[yao-matrix]

@matthewdouglas @jiqing-feng , pls help review and comment, thx very much.

[matthewdouglas]

Makes sense, thanks! Let's just fix the lint issue and we can merge it.

Related issue: #1332

[github-actions]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.