skip to content
Any OpenAI-compatible endpoint

Bring your own endpoint

Any OpenAI-compatible endpoint

If it answers /v1/chat/completions, the CLI can route to it.

vLLM, Ollama, LM Studio, llama.cpp’s server, a colleague’s machine, or an internal deployment behind your own gateway: anything that speaks the OpenAI wire can be registered as a remote endpoint and named like any other model.

Register one

The credential is read from stdin, never from argv, so it cannot land in your shell history or in the process list. It is stored in the OS secret store under a reference derived from the endpoint id; the registry file itself holds no secret.

terminal
printf %s "$TOKEN" | conifer endpoints add remote studio-m2 \
  --url https://models.internal.example.com/v1 \
  --token

The upstream is probed live at GET /v1/models as part of the add, and the models it enumerates become nameable targets for conifer run. If it answers 401 or 403 and you passed no --token, the add is refused and names the flag; if it cannot be reached at all, the add is refused unless you pass --force, which records the suite as catalog. An id is kind:slug, so the endpoint above is remote:studio-m2, and a duplicate id is refused rather than silently renamed.

Plain HTTP is allowed, deliberately narrowly

Boxes on a LAN routinely serve without TLS, so a remote endpoint accepts plain http to loopback and to private addresses — RFC1918, carrier-grade NAT, link-local, and *.local names:

terminal
conifer endpoints add remote workshop \
  --url http://192.168.1.40:11434/v1

The add discloses, in the output, that the traffic and the bearer cross the LAN in cleartext. An arbitrary public http URL is refused outright.

Remote versus BYOK

KindUse it forScheme rule
remoteA server you run: vLLM, Ollama, an internal deployment.https anywhere; http to loopback or a private/LAN address.
byokA commercial provider key held in local custody, egressing direct to the provider.https or loopback only. A provider key never crosses a cleartext wire.

Inspect and remove

terminal
conifer endpoints list
conifer endpoints show remote:studio-m2
conifer endpoints remove remote:studio-m2