rin.kagamine
097a29eaee
Adds default_hide_zero_spend valve (default True) that controls whether models with sub-bash.001 spend are hidden by default. The per-call hide_zero_spend parameter can explicitly override: - hide_zero_spend=True → ALWAYS hide (explicit override) - hide_zero_spend=False → use valve default (default_hide_zero_spend) This defensive design prevents SLMs from accidentally exposing zero-spend models unless the human has explicitly set default_hide_zero_spend=False. - Added default_hide_zero_spend valve to Valves class - Updated litellm_cost() with two-level logic - Updated README and ARCHITECTURE.md with two-level design docs - Reverted parameter name back to hide_zero_spend
78 lines
3.9 KiB
Markdown
78 lines
3.9 KiB
Markdown
# LiteLLM Dashboard — Open WebUI Tool
|
|
|
|
A simple, three-function Open WebUI Tool for checking LiteLLM proxy health, cost breakdowns, and recent request history.
|
|
|
|
## Functions
|
|
|
|
### `litellm_health`
|
|
Check LiteLLM proxy health and authentication status. Returns which models are healthy/unhealthy, their rate limits, and any auth errors.
|
|
|
|
### `litellm_cost`
|
|
Get LiteLLM cost breakdown for a date range. Returns per-model and per-day spend, token counts, cache hit rate, and request stats.
|
|
|
|
**Parameters:**
|
|
- `start_date` (str, required): Start date — YYYY-MM-DD or natural language shortcut (e.g. "2026-06-01", "today", "yesterday", "monday", "last monday", "two days ago", "this week", "last month")
|
|
- `end_date` (str, required): End date — YYYY-MM-DD or natural language shortcut
|
|
- `hide_zero_spend` (bool, default false): When True, force-hide models with sub-$0.001 spend. When False, use the valve-configured default (see `default_hide_zero_spend` below). This two-level design lets the human set a default via valves while allowing the SLM to explicitly override on a per-call basis.
|
|
|
|
### `litellm_history`
|
|
Get recent LiteLLM request history. Returns the most recent N requests with model, call type, status, duration, token counts, cache hit %, and per-request cost. Useful for understanding which models are being called and how much individual requests cost.
|
|
|
|
**Parameters:**
|
|
- `limit` (int, 1-50, default 20): Number of recent requests to show
|
|
- `show_cost` (bool, default true): Include per-request cost
|
|
- `show_failed` (bool, default true): Include failed requests. Set false to hide auth failures, routing errors, and probe noise.
|
|
|
|
**Cost awareness:** This function hits `/spend/logs` which returns all historical logs. For large deployments, this can be a heavy query. Use reasonable `limit` values.
|
|
|
|
## Valves (Configuration)
|
|
|
|
| Valve | Default | Purpose |
|
|
|-------|---------|---------|
|
|
| `litellm_url` | `http://localhost:4000` | LiteLLM proxy base URL |
|
|
| `litellm_master_key` | (empty) | LiteLLM master API key (password field) |
|
|
| `default_hide_zero_spend` | `True` | Default behavior for zero-spend model filtering. When True, models with sub-$0.001 spend are hidden by default. The per-call `hide_zero_spend` parameter can override this. |
|
|
|
|
Both valves are passed at runtime — no hardcoded keys. The tool is portable to any LiteLLM proxy instance.
|
|
|
|
## Installation
|
|
|
|
1. Copy `litellm_dashboard.py` to your Open WebUI Workspace or import via Admin → Tools
|
|
2. Configure the two valves with your LiteLLM proxy URL and master key
|
|
3. Enable the tool on a per-model or per-chat basis
|
|
|
|
## Requirements
|
|
|
|
- `requests` (standard pip package)
|
|
- Open WebUI 0.4.0+
|
|
- A running LiteLLM proxy instance
|
|
|
|
## Design Principles
|
|
|
|
- **Three functions, that's it.** No scope creep.
|
|
- **Portable.** No hardcoded URLs or keys.
|
|
- **Token-efficient.** Strips `litellm_metadata` (~2KB/model) from health responses. Formats cost data as readable text, not raw JSON dumps.
|
|
- **General-purpose.** Works with any LiteLLM proxy instance.
|
|
- **Read-only.** GET endpoints only. No mutations, no risk.
|
|
|
|
## Documentation
|
|
|
|
- **[ARCHITECTURE.md](ARCHITECTURE.md)** — Full architecture and design doc: API endpoints, response processing, stripped fields, error paths, future considerations, changelog.
|
|
- **This README** — Quick reference: install, functions, valves, design principles.
|
|
|
|
## Changelog
|
|
|
|
### v1.2.0 (2026-06-13)
|
|
- **feat:** Natural language date shortcuts for `litellm_cost()` — `today`, `yesterday`, `monday`, `last week`, etc.
|
|
- **feat:** `hide_zero_spend` parameter for `litellm_cost()` — default True hides sub-$0.001 models with summary line; per-call parameter can override
|
|
- **fix:** Cost report header shows resolved YYYY-MM-DD dates instead of raw shortcuts
|
|
|
|
### v1.1.0 (2026-06-13)
|
|
- Initial public release
|
|
- Three functions: `litellm_health`, `litellm_cost`, `litellm_history`
|
|
- Valve-based configuration (no hardcoded keys)
|
|
- Token-efficient response formatting
|
|
|
|
## License
|
|
|
|
MIT |