Debian
01bd921ced
- New: smart-home/home-assistant-dashboard-conventions (Mushroom cards, view tabs, no Bubble Cards) - Updated: rke2, ceph, galera, proxmox, brainstorming, compound-learning, 1password-cli, smart-home-automation skills - New references: ceph-cluster-administration, docker-volume-forensics, ceph-crush-weight, ceph-ec-mixed-size
50 lines
3.0 KiB
Markdown
50 lines
3.0 KiB
Markdown
# ai.noris.de Model Catalog (from /v1/models API)
|
|
|
|
Retrieved 2026-07-13 via `GET https://ai.noris.de/v1/models` with Bearer auth.
|
|
|
|
## vllm/release/ Models (free for noris employees)
|
|
|
|
| Model ID | Context | Max Input | Max Output | Type | Vision |
|
|
|----------|---------|-----------|------------|------|--------|
|
|
| `vllm/release/glm-5-2` | 1,048,576 (1M) | 1M | 1M | General LLM | ❌ |
|
|
| `vllm/release/gemma-4-31b-it` | 131,072 (128K) | 128K | 128K | Vision LLM | ✅ |
|
|
| `vllm/release/gpt-oss-120b` | 131,072 (128K) | 128K | 128K | General LLM | ❌ |
|
|
| `vllm/release/qwen3.6-27b` | 262,144 (256K) | 256K | 8,192 (8K) | Text LLM | ❌ |
|
|
| `vllm/release/qwen3.5-122b-a10b` | — | — | — | MoE Vision | ⚠️ poor quality |
|
|
| `vllm/release/qwen3.6-35b-a3b` | — | — | — | MoE LLM | ❌ |
|
|
| `vllm/release/harrier-oss-v1-0.6b` | 8,192 (8K) | 8K | — | Embedding | N/A |
|
|
| `vllm/release/qwen3-embedding-8b` | — | — | — | Embedding | N/A |
|
|
| `vllm/release/bge-reranker-v2-m3` | 32,000 (32K) | 32K | — | Reranker | N/A |
|
|
| `vllm/release/jina-reranker-v2-base-multilingual` | — | — | — | Reranker | N/A |
|
|
|
|
Some models (qwen3.5-122b-a10b, qwen3.6-35b-a3b, harrier-oss-v1-0.6b, qwen3-embedding-8b, jina-reranker-v2) return no context/pricing fields — only `id` + `owned_by`.
|
|
|
|
## Anthropic Models (costs apply for noris employees)
|
|
|
|
| Model ID | Context | Max Output | Prompt/1K | Completion/1K |
|
|
|----------|---------|------------|-----------|---------------|
|
|
| `anthropic/claude-fable-5` | 1M | 128K | $0.010 | $0.050 |
|
|
| `anthropic/claude-opus-4-8` | 1M | 128K | $0.005 | $0.025 |
|
|
| `anthropic/claude-opus-4-7` | 1M | 128K | $0.005 | $0.025 |
|
|
| `anthropic/claude-opus-4-6` | 1M | 128K | $0.030 | $0.150 |
|
|
| `anthropic/claude-opus-4-5-20251101` | 200K | 64K | $0.005 | $0.025 |
|
|
| `anthropic/claude-opus-4-1-20250805` | 200K | 32K | $0.015 | $0.075 |
|
|
| `anthropic/claude-sonnet-5` | 1M | 128K | $0.002 | $0.010 |
|
|
| `anthropic/claude-sonnet-4-6` | 1M | 128K | $0.003 | $0.015 |
|
|
| `anthropic/claude-sonnet-4-5-20250929` | 200K | 64K | $0.003 | $0.015 |
|
|
| `anthropic/claude-haiku-4-5-20251001` | 200K | 64K | $0.001 | $0.005 |
|
|
|
|
## Key Facts
|
|
|
|
- **Model prefix `vllm/release/` is mandatory** — bare names (e.g. `glm-5-2`) fail
|
|
- **API is OpenAI-compatible**: `/v1/chat/completions`, `/v1/embeddings`
|
|
- **Base URL**: `https://ai.noris.de` — Docs: `https://ai.noris.de/docs/`
|
|
- **Auth**: Bearer token (API key from Hermes config or noris portal)
|
|
- **13 Anthropic models** available alongside vLLM models via the same API
|
|
- Pricing fields in API response are for external customers — noris employees don't pay for `vllm/release/` models
|
|
- **Anthropic models cost money even for noris employees** — only `vllm/release/` models are free internally
|
|
- **glm-5-2** has 1M context — largest context window in the vLLM lineup
|
|
- **qwen3.6-27b** has only 8K max output despite 256K input — watch this asymmetry
|
|
- Embedding alternatives: `harrier-oss-v1-0.6b` (8K ctx) and `qwen3-embedding-8b` (unknown ctx)
|
|
- Two rerankers available: `bge-reranker-v2-m3` (32K) and `jina-reranker-v2-base-multilingual`
|