Files
Hermes-Ollama_Models/README.md
T

1.8 KiB

Hermes Ollama Models

Native-like Hermes dashboard plugin for local Ollama model management and chat.

Chat capabilities

  • Select an installed Ollama model and load it into memory
  • Chat through Ollama's native /api/chat endpoint
  • Attach screenshots and JPEG/PNG/WebP images for vision-capable models
  • Attach text PDFs; PDF text is extracted with pypdf
  • Add public HTTP/HTTPS URLs for HTML/text, images, or PDFs
  • View live host RAM and swap statistics
  • View Ollama's loaded-model memory split: total, GPU VRAM, and normal RAM/offload
  • View NVIDIA GPU telemetry when nvidia-smi is available

The chat transcript and selected model are persisted in this browser, so navigating away from the plugin or reloading the dashboard does not clear the conversation. Use Clear chat to remove the saved transcript. The UI also shows a prominent live processing status while Ollama is working, including an animated indicator, elapsed time, request preparation, and response-generation stages. This is operational progress only; private model chain-of-thought is not exposed. Uploaded files remain temporary and are not stored in browser persistence.

Security limits

  • Uploaded files are limited to 20 MiB each
  • Fetched URLs are limited to 15 MiB and a 30-second timeout
  • Private, loopback, link-local, reserved, multicast, and unspecified URL targets are blocked, including redirect destinations
  • Remote documents are inserted as untrusted content, not system instructions
  • Only locally installed models can be selected or loaded; chat does not download models

Dependency

Install the plugin's Python dependency in the Hermes runtime environment:

pip install -r requirements.txt

pypdf is required for text-based PDF extraction. Scanned/image-only PDFs need OCR and are not converted to text by this plugin.