1.2 KiB
1.2 KiB
Noris / vLLM Model Name Prefix Pitfall
Problem
When a model name contains a vllm/ prefix (e.g. vllm/moonshotai/kimi-k2.6) inside model.model or model.default, Hermes resolves it to noris/vllm/moonshotai/kimi-k2.6. This fails model catalog lookup because the prefix is interpreted as part of the model string, not a provider qualifier.
When It Happens
- Profile was previously configured for a custom/local vLLM endpoint where
vllm/…is required - Later migrated to Noris (managed provider) without stripping the prefix
- Any provider where model catalog lookup happens (OpenRouter, Nous Portal, Noris, etc.)
Fix
Strip the vllm/ prefix when using a managed provider:
hermes config set model.model moonshotai/kimi-k2.6
hermes config set model.default moonshotai/kimi-k2.6
When using a custom vLLM endpoint (e.g. local server on http://10.0.30.99:8080/v1), keep the prefix:
model:
model: vllm/moonshotai/kimi-k2.6
provider: custom
base_url: http://10.0.30.99:8080/v1
Detection
Check if hermes config shows a vllm/ prefix in the Model line:
hermes config | grep -E "Model:|model:"
If it shows vllm/ and the provider is Noris/OpenRouter/Nous (not custom), strip it.