29 lines
1.2 KiB
Markdown
29 lines
1.2 KiB
Markdown
# Hermes Ollama Models
|
|
|
|
Native-like Hermes dashboard plugin for inspecting and managing a local Ollama installation.
|
|
|
|
## Included
|
|
|
|
- Installed and currently loaded Ollama model inventory
|
|
- Model size, loaded memory, estimated RAM, quantization, context, capabilities, and strengths
|
|
- Dense versus MoE classification
|
|
- Search, popular models, family variants, downloads, updates, and removal actions
|
|
- MLX model exclusion
|
|
- RAM-aware Popular view for the current 30 GiB host
|
|
|
|
## RAM-aware Popular policy
|
|
|
|
The Popular view only displays models with known size and known estimated baseline RAM at or below 30 GiB. When an oversized popular family has a known smaller fitting variant, the smaller variant is shown instead. Equivalent model footprints are deduplicated.
|
|
|
|
The estimate is a baseline and actual usage varies with context length, KV cache, GPU offload, batching, and runtime overhead.
|
|
|
|
## Layout
|
|
|
|
- `plugin.yaml` — Hermes plugin metadata
|
|
- `dashboard/manifest.json` — native dashboard registration
|
|
- `dashboard/plugin_api.py` — Ollama API and catalog backend
|
|
- `dashboard/dist/index.js` — dashboard UI bundle
|
|
- `dashboard/dist/style.css` — dashboard styles
|
|
|
|
Runtime catalog data is intentionally stored in Hermes state rather than committed here.
|