Local does not mean private by default
Ollama listens on 127.0.0.1:11434 by default. That is convenient on one computer, but the service does not automatically become safe for an office network if its port is exposed. The documentation allows changing the bind address with OLLAMA_HOST and describes proxy access, but forwarding requests is not authentication.
A typical risk is simple: a developer changes the address to 0.0.0.0 so colleagues can reach the model, and the port becomes available to an entire network segment. Users may then gain access to generation, GPU capacity, downloaded models and internal tools connected to the system.
A minimum shared-service design
Start by listing users and use cases. For a pilot, keep Ollama bound to loopback behind a gateway that:
- authenticates an employee or service account;
- allows only required methods and models;
- limits request rates and sizes;
- records an audit trail without retaining unnecessary prompt content.
Route access from outside the office through a VPN or TLS-protected gateway. The firewall should permit connections to the gateway while blocking direct connections to Ollama’s port from workstations and guest networks.
Test for bypasses
Test three paths: an allowed user through the gateway, a request without a token and a direct request to the model port. The first should work, the second should be rejected and the third should be unreachable. Repeat from a laptop on another VLAN and after a service restart.
Do not rely on CORS or an unlisted URL. CORS constrains browsers, not arbitrary clients; a secret embedded in a client application is not a substitute for user identity.
Before loading documents, define processing rules, log retention, access to history and account revocation. Limits on concurrent requests can prevent overload, but they do not replace authentication and network segmentation.
A practical next step
Use a synthetic document and two accounts—one permitted and one disabled. Verify authentication, logging and the absence of direct API access before connecting work documents or a CRM.
