VOOZH about

URL: https://github.com/orgs/community/discussions/200311

⇱ How to configure an OpenAI Compatibe Model Provider which supports dynamic model discovery? Β· community Β· Discussion #200311 Β· GitHub


Skip to content

πŸ‘ @community
GitHub Community

How to configure an OpenAI Compatibe Model Provider which supports dynamic model discovery? #200311

πŸ‘ Image
singhal-shagun

Answered by rdpsawada

Right now, VS Code doesn’t expose automatic model discovery for custom endpoints configured through chatLanguageModels.json the same way it does for built-in providers or provider extensions. That JSON-based setup is static, you must define models manually. Dynamic discovery (for example, calling an OpenAI-compatible /v1/models endpoint and populating the model list automatically) is handled by provider implementations, not by the generic custom endpoint configuration. So if you want users to enter only a base URL + API key and have models appear automatically, the supported path today is to build a language model provider extension that implements discovery logic and surfaces the models …

Replies: 5 comments Β· 2 replies

πŸ‘ Image
rdpsawada

0 replies
Answer selected by singhal-shagun

πŸ‘ Image
kartik99917

0 replies

πŸ‘ Image
khazar08

0 replies
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.