Skip to content

Commit

Permalink
Chore: update submodule (#81)
Browse files Browse the repository at this point in the history
  • Loading branch information
XprobeBot authored Jan 10, 2025
1 parent 9573f28 commit 358e3fe
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion third_party/inference
Submodule inference updated 79 files
+1 −0 .github/workflows/python.yaml
+4 −3 README.md
+4 −3 README_zh_CN.md
+2 −1 doc/source/getting_started/installation.rst
+73 −0 doc/source/locale/zh_CN/LC_MESSAGES/user_guide/vllm_enhancement.po
+20 −0 doc/source/models/builtin/image/hunyuandit-v1.2-distilled.rst
+20 −0 doc/source/models/builtin/image/hunyuandit-v1.2.rst
+4 −0 doc/source/models/builtin/image/index.rst
+7 −0 doc/source/models/builtin/llm/index.rst
+1 −1 doc/source/models/builtin/llm/minicpm3-4b.rst
+47 −0 doc/source/models/builtin/llm/qvq-72b-preview.rst
+18 −0 doc/source/models/builtin/video/hunyuanvideo.rst
+2 −0 doc/source/models/builtin/video/index.rst
+1 −0 doc/source/user_guide/backends.rst
+1 −0 doc/source/user_guide/index.rst
+23 −0 doc/source/user_guide/vllm_enhancement.rst
+4 −2 setup.cfg
+49 −65 xinference/api/restful_api.py
+26 −0 xinference/client/tests/test_client.py
+77 −19 xinference/core/model.py
+81 −10 xinference/core/supervisor.py
+0 −5 xinference/core/tests/test_continuous_batching.py
+2 −2 xinference/core/utils.py
+32 −0 xinference/core/worker.py
+18 −0 xinference/model/image/model_spec.json
+20 −0 xinference/model/image/model_spec_modelscope.json
+2 −0 xinference/model/llm/__init__.py
+96 −0 xinference/model/llm/llm_family.json
+99 −0 xinference/model/llm/llm_family_modelscope.json
+23 −73 xinference/model/llm/mlx/core.py
+272 −0 xinference/model/llm/transformers/cogagent.py
+1 −0 xinference/model/llm/transformers/core.py
+10 −1 xinference/model/llm/transformers/qwen2_vl.py
+27 −3 xinference/model/llm/utils.py
+37 −7 xinference/model/llm/vllm/core.py
+13 −0 xinference/model/llm/vllm/xavier/__init__.py
+74 −0 xinference/model/llm/vllm/xavier/allocator.py
+112 −0 xinference/model/llm/vllm/xavier/block.py
+71 −0 xinference/model/llm/vllm/xavier/block_manager.py
+116 −0 xinference/model/llm/vllm/xavier/block_tracker.py
+247 −0 xinference/model/llm/vllm/xavier/engine.py
+132 −0 xinference/model/llm/vllm/xavier/executor.py
+422 −0 xinference/model/llm/vllm/xavier/scheduler.py
+13 −0 xinference/model/llm/vllm/xavier/test/__init__.py
+122 −0 xinference/model/llm/vllm/xavier/test/test_xavier.py
+298 −0 xinference/model/llm/vllm/xavier/transfer.py
+14 −0 xinference/model/video/diffusers.py
+15 −0 xinference/model/video/model_spec.json
+16 −0 xinference/model/video/model_spec_modelscope.json
+13 −0 xinference/types.py
+69 −3 xinference/web/ui/package-lock.json
+2 −0 xinference/web/ui/package.json
+16 −17 xinference/web/ui/src/App.js
+55 −44 xinference/web/ui/src/components/MenuSide.js
+1 −6 xinference/web/ui/src/components/Title.js
+3 −2 xinference/web/ui/src/components/hotkeyFocusTextField.js
+20 −0 xinference/web/ui/src/components/themeButton.js
+36 −0 xinference/web/ui/src/components/themeContext.js
+74 −0 xinference/web/ui/src/components/translateButton.js
+24 −0 xinference/web/ui/src/i18n.js
+2 −0 xinference/web/ui/src/index.js
+186 −0 xinference/web/ui/src/locales/en.json
+186 −0 xinference/web/ui/src/locales/zh.json
+9 −4 xinference/web/ui/src/scenes/cluster_info/index.js
+52 −28 xinference/web/ui/src/scenes/cluster_info/nodeInfo.js
+8 −5 xinference/web/ui/src/scenes/launch_model/LaunchModelComponent.js
+16 −9 xinference/web/ui/src/scenes/launch_model/index.js
+23 −8 xinference/web/ui/src/scenes/launch_model/launchCustom.js
+16 −11 xinference/web/ui/src/scenes/launch_model/launchLLM.js
+238 −93 xinference/web/ui/src/scenes/launch_model/modelCard.js
+4 −0 xinference/web/ui/src/scenes/launch_model/styles/modelCardStyle.css
+8 −4 xinference/web/ui/src/scenes/register_model/components/addControlnet.js
+18 −12 xinference/web/ui/src/scenes/register_model/components/addModelSpecs.js
+6 −3 xinference/web/ui/src/scenes/register_model/components/addStop.js
+21 −7 xinference/web/ui/src/scenes/register_model/index.js
+57 −50 xinference/web/ui/src/scenes/register_model/registerModel.js
+4 −4 xinference/web/ui/src/scenes/register_model/styles/registerModelStyle.css
+30 −28 xinference/web/ui/src/scenes/running_models/index.js
+6 −3 xinference/web/ui/src/theme.js

0 comments on commit 358e3fe

Please sign in to comment.