Initial commit: Hermes Agent Skills collection
This commit is contained in:
@@ -0,0 +1,38 @@
|
||||
# Noris / vLLM Model Name Prefix Pitfall
|
||||
|
||||
## Problem
|
||||
|
||||
When a model name contains a `vllm/` prefix (e.g. `vllm/moonshotai/kimi-k2.6`) inside `model.model` or `model.default`, Hermes resolves it to `noris/vllm/moonshotai/kimi-k2.6`. This fails model catalog lookup because the prefix is interpreted as part of the model string, not a provider qualifier.
|
||||
|
||||
## When It Happens
|
||||
|
||||
- Profile was previously configured for a **custom/local vLLM endpoint** where `vllm/…` is required
|
||||
- Later migrated to **Noris (managed provider)** without stripping the prefix
|
||||
- Any provider where model catalog lookup happens (OpenRouter, Nous Portal, Noris, etc.)
|
||||
|
||||
## Fix
|
||||
|
||||
Strip the `vllm/` prefix when using a managed provider:
|
||||
|
||||
```bash
|
||||
hermes config set model.model moonshotai/kimi-k2.6
|
||||
hermes config set model.default moonshotai/kimi-k2.6
|
||||
```
|
||||
|
||||
When using a **custom vLLM endpoint** (e.g. local server on `http://10.0.30.99:8080/v1`), keep the prefix:
|
||||
|
||||
```yaml
|
||||
model:
|
||||
model: vllm/moonshotai/kimi-k2.6
|
||||
provider: custom
|
||||
base_url: http://10.0.30.99:8080/v1
|
||||
```
|
||||
|
||||
## Detection
|
||||
|
||||
Check if `hermes config` shows a `vllm/` prefix in the Model line:
|
||||
```bash
|
||||
hermes config | grep -E "Model:|model:"
|
||||
```
|
||||
|
||||
If it shows `vllm/` and the provider is Noris/OpenRouter/Nous (not `custom`), strip it.
|
||||
Reference in New Issue
Block a user