feat: integrate SoLA for LLM SVD decomposition

[xinhaoH]

PR Category

PR Types

PR Description

This branch introduces an LLM decomposition method based on SoLA.

[CLAassistant]

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
_{You have signed the CLA already but the status is still pending? Let us recheck it.}