40 lines
2.2 KiB
Markdown
40 lines
2.2 KiB
Markdown
# Hermes Ollama Models
|
|
|
|
Native-like Hermes dashboard plugin for local Ollama model management and chat.
|
|
|
|
## Chat capabilities
|
|
|
|
- Select an installed Ollama model and load it into memory
|
|
- Chat through Ollama's native `/api/chat` endpoint
|
|
- Attach screenshots and JPEG/PNG/WebP images for vision-capable models
|
|
- Attach text PDFs; PDF text is extracted with `pypdf`
|
|
- Add public HTTP/HTTPS URLs for HTML/text, images, or PDFs
|
|
- View live host RAM and swap statistics
|
|
- View Ollama's loaded-model memory split: total, GPU VRAM, and normal RAM/offload
|
|
- View NVIDIA GPU telemetry when `nvidia-smi` is available
|
|
- Chat is the default view when the Ollama Models plugin opens
|
|
- Natural composer behavior: Enter sends; Shift+Enter creates a new line
|
|
- Paste images directly into the composer and drag/drop images, PDFs, and text files
|
|
- Streamed Ollama responses with a real Stop action that cancels the active request
|
|
- Minimized-by-default expandable thinking/progress details with live stage, elapsed time, event, and character counters
|
|
|
|
The chat transcript and selected model are persisted in this browser, so navigating away from the plugin or reloading the dashboard does not clear the conversation. Use **Clear chat** to remove the saved transcript. The UI also shows a prominent live processing status while Ollama is working, including an animated indicator, elapsed time, request preparation, and response-generation stages. This is operational progress only; private model chain-of-thought is not exposed. Uploaded files remain temporary and are not stored in browser persistence.
|
|
|
|
## Security limits
|
|
|
|
- Uploaded files are limited to 20 MiB each
|
|
- Fetched URLs are limited to 15 MiB and a 30-second timeout
|
|
- Private, loopback, link-local, reserved, multicast, and unspecified URL targets are blocked, including redirect destinations
|
|
- Remote documents are inserted as untrusted content, not system instructions
|
|
- Only locally installed models can be selected or loaded; chat does not download models
|
|
|
|
## Dependency
|
|
|
|
Install the plugin's Python dependency in the Hermes runtime environment:
|
|
|
|
```bash
|
|
pip install -r requirements.txt
|
|
```
|
|
|
|
`pypdf` is required for text-based PDF extraction. Scanned/image-only PDFs need OCR and are not converted to text by this plugin.
|