fizzlepoof/truenas-stacks
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Move reranker to Serenity, add monitoring and mesh-mqtt-observer stacks

Browse Source 
- ai: remove reranker service (moved to Serenity at 10.5.1.5:9787)
- ai: add LiteLLM reranker proxy entry for Serenity
- ai: configure OpenWebUI to use LiteLLM for reranking
- monitoring: add Grafana + Prometheus stack
- mesh-mqtt-observer: add new service
- automation, documents, meshtastic: misc updates
This commit is contained in:
root
2026-05-09 10:42:54 -05:00
parent b2cbe4444c
commit 6c19f82a0a
17 changed files with 1115 additions and 23 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
ai/litellm/config.yaml
View File

@@ -1,4 +1,9 @@
model_list:
# ---- Reranker (Serenity, 10.5.1.5) ----
- model_name: "reranker"
litellm_params:
model: "huggingface/BAAI/bge-reranker-v2-m3"
api_base: "http://10.5.1.5:9787"
# ---- ROCINANTE (RTX 4090, 24GB) — heavy reasoning ----
- model_name: "heavy"
litellm_params: