Add Hermes Ollama Models dashboard plugin
This commit is contained in:
@@ -0,0 +1,28 @@
|
||||
# Hermes Ollama Models
|
||||
|
||||
Native-like Hermes dashboard plugin for inspecting and managing a local Ollama installation.
|
||||
|
||||
## Included
|
||||
|
||||
- Installed and currently loaded Ollama model inventory
|
||||
- Model size, loaded memory, estimated RAM, quantization, context, capabilities, and strengths
|
||||
- Dense versus MoE classification
|
||||
- Search, popular models, family variants, downloads, updates, and removal actions
|
||||
- MLX model exclusion
|
||||
- RAM-aware Popular view for the current 30 GiB host
|
||||
|
||||
## RAM-aware Popular policy
|
||||
|
||||
The Popular view only displays models with known size and known estimated baseline RAM at or below 30 GiB. When an oversized popular family has a known smaller fitting variant, the smaller variant is shown instead. Equivalent model footprints are deduplicated.
|
||||
|
||||
The estimate is a baseline and actual usage varies with context length, KV cache, GPU offload, batching, and runtime overhead.
|
||||
|
||||
## Layout
|
||||
|
||||
- `plugin.yaml` — Hermes plugin metadata
|
||||
- `dashboard/manifest.json` — native dashboard registration
|
||||
- `dashboard/plugin_api.py` — Ollama API and catalog backend
|
||||
- `dashboard/dist/index.js` — dashboard UI bundle
|
||||
- `dashboard/dist/style.css` — dashboard styles
|
||||
|
||||
Runtime catalog data is intentionally stored in Hermes state rather than committed here.
|
||||
Reference in New Issue
Block a user