Unable to use autocomplete

[Sanoopck10]

I am not able to use the autocomplete feature. I've added an 'OpenAI-Compatible' model and I'm able to use the chat window. But auto complete is not triggered when I'm doing file changes. Any configuration that I may be missing?

[andrewpareles]

It's not available in the current beta. We do have an implementation of this feature, but we found it didn't work very well on just any OSS model.

If you really wanted to have it for a specific purpose (e.g you built your own FIM autocomplete model and want to experiment with it) we can enable it for you, but we wanted to make it better before releasing it in general.

[andrewpareles]

Goal: turn on autocomplete and get it working well. This probably involves limiting the models the user can pick when using autocomplete, e.g. only allowing codestral fim.

[Sanoopck10]

It would be good if I can get the current implementation enabled. I'm trying out things with the model that I have, and autocomplete is one of them. Will try it out and let you know the results.

[andrewpareles]

@mathewpareles built autocomplete and can help you out!

[andrewpareles]

Update: we're adding a few model guardrails to autocomplete, and we plan on re-releasing it soon