Skip to content

Update the serving multiple AI models guide with multiple LoRA example #1858

@davidbreitgand

Description

@davidbreitgand

Add an example of serving multiple LoRAs per base model when serving multiple base models with BBR.
Related to this issue in llm-d

Metadata

Metadata

Assignees

No one assigned

    Labels

    needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions