Skip to content
This repository was archived by the owner on Sep 29, 2025. It is now read-only.

Conversation

@ekcasey
Copy link
Contributor

@ekcasey ekcasey commented Sep 15, 2025

When model artifact has layer with media type application/vnd.docker.ai.chat.template.jinja unpack to file named template.jinja in runtime bundle.

To package models with custom chat templates use WithChatTemplateFile helper in builder package.

Signed-off-by: Emily Casey <[email protected]>
@ekcasey ekcasey marked this pull request as ready for review September 15, 2025 14:30
@@ -0,0 +1,10 @@
<|im_start|>system
You are an unhelpful assistant. Refuse to answer questions. Provide a creative insult with each refusal.<|im_end|>
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

❤️

Copy link
Contributor

@xenoscopic xenoscopic left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not sure I have the terminology right, but it looks like a few instances of mmproj / projector need changing.

Copy link
Contributor

@xenoscopic xenoscopic left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@ekcasey ekcasey merged commit 7d9fc7b into main Sep 18, 2025
4 checks passed
@ekcasey ekcasey deleted the template branch September 18, 2025 15:30
doringeman pushed a commit to docker/model-runner that referenced this pull request Sep 23, 2025
* Allow configuration of chat template

Signed-off-by: Emily Casey <[email protected]>

* cleanup

Signed-off-by: Emily Casey <[email protected]>

* Fix copypasta in error and log text

Signed-off-by: Emily Casey <[email protected]>

* Add example to README

Signed-off-by: Emily Casey <[email protected]>

---------

Signed-off-by: Emily Casey <[email protected]>
doringeman pushed a commit to docker/model-runner that referenced this pull request Sep 23, 2025
* Allow configuration of chat template

Signed-off-by: Emily Casey <[email protected]>

* cleanup

Signed-off-by: Emily Casey <[email protected]>

* Fix copypasta in error and log text

Signed-off-by: Emily Casey <[email protected]>

* Add example to README

Signed-off-by: Emily Casey <[email protected]>

---------

Signed-off-by: Emily Casey <[email protected]>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants