Personal AI Infrastructure (On-Prem)
Hermes Hub
The Challenge
Wanted AI-assisted workflows — tool orchestration, home-automation oversight, day-to-day task handling — without every request leaving the building by default, and without getting locked into a single model vendor.
The Approach
Local hardware runs a local model for sensitive or routine tasks; an explicit routing policy escalates to cloud models only for work that genuinely needs the extra capability, visibly rather than silently. Tool access is unified through MCP instead of one-off integrations per tool, and home-automation control is kept strictly advisory — it can suggest and flag, never write to a device unattended.
The Outcome
This is the install we productized as the Private AI Appliance. The routing policy, the MCP integration catalog, and the advisory-only device-control boundary are the same ones we ship on-site.
Stack
- Local inference hardware
- MCP tool routing
- Hybrid cloud fallback