Government and enterprise
AI governance for government and enterprise
Conifer records which model ran, what it cost and which key sent each request, and applies your limits before a request reaches a model provider.
What it covers
Organizations that use AI models across many teams need to answer three questions about each request: who sent it, which model answered, and what it cost. They also need to stop requests that fall outside policy before they run. The Conifer gateway and router are built around those questions.
Limits apply before a request reaches a model provider, and every request leaves a record of the model, the key and the cost.
Controls applied before a request runs
- Model scope per key
- A team admin can limit a key to a list of named models. The key cannot call any other model. The scope follows the live catalog, so a new model needs no new key.
- Approved routing pool
- When Conifer chooses the model, it chooses only from the routing pool the team owner sets.
- Spend cap per key
- Once a key reaches its own spend cap, its requests are refused, whatever the account balance.
- Monthly limit
- A monthly charge limit bounds the total spend on the account.
- Ceiling per request
- A request can carry a hard cost ceiling. If it could cost more, it is refused before any provider is called and nothing is spent.
- Prepaid balance
- A request the balance cannot cover is refused and costs nothing.
- Revocation
- Keys are revoked one at a time and stop working within seconds. Other keys are not affected. A person who leaves or is removed from a team loses their company keys.
A record of every request
- Requested and served model
- Every response names the model the caller asked for and the model that answered.
- Reason
- It also says why: served as requested, served by another provider after a failure, or chosen by the router.
- Cost
- The settled cost of the request, broken down into input, output and cached tokens.
- Request id
- A unique id for each request, for support and reconciliation.
- Usage by key
- The console shows requests and cost for each key. On a team, owners and admins see team usage.
- Retained details
- For each request Conifer keeps the account and key that made it, the model, the provider, token counts, the charge, timings and any error, without the text of the prompt or response.
# Receipt headers on an example response
x-conifer-requested-model: claude-sonnet-5-5
x-conifer-effective-model: claude-sonnet-5-5
x-conifer-receipt-reason: as_requested
x-conifer-cost-nanousd: 1842000 # $0.001842How request data is handled
- Prompts
- The gateway does not store the prompt of a standard request.
- Response cache
- A response is held for ten minutes so that a retried request returns the original response instead of being charged twice.
- Training
- Conifer does not use customer content to train models, its own or a third party’s.
- Model providers
- The provider that serves a request handles it under its own terms, including how long it keeps requests. Naming a model lets you send a workload only to a model whose provider terms you have reviewed.
- Automatic model choice
- When Conifer chooses the model, the request content also goes to the router, which may be Conifer’s router service or a decision model hosted by one of its model providers. A named request does not.
- Your own provider contract
- An Azure OpenAI resource you own can sit behind the Conifer key. Usage on it is billed to your Azure agreement, the key is verified before it is stored and is kept encrypted, and Conifer adds no fee.
- Subprocessors
- The companies that process data for Conifer are listed on the subprocessors page. The privacy policy sets out retention for each kind of data.
Not available today
These are stated so that you can plan around them.
- AWS Bedrock and Google Vertex
- Not served as bring-your-own endpoints.
- Azure identity
- Entra ID and managed identity are not available on the self-serve Azure form.
- Team creation
- There is no console button to create a team. Conifer sets up team accounts on request.
- Sign-in
- The console accepts email and password, Google or GitHub.
Questions
- Can we limit which AI models our staff can use?
- Yes. A team admin can limit each key to a list of named models, and the router chooses only from the routing pool the team owner sets. A key limited to named models cannot use the router.
- Can we see which model answered each request?
- Yes. Every response names the model that was requested and the model that served it, the reason it was served that way, and its cost. The console shows requests and cost for each key.
- Does Conifer use our data to train models?
- No. Conifer does not use customer content to train models, its own or a third party’s. The provider that serves a request handles it under its own terms.
- Can we keep our existing Azure OpenAI agreement?
- Yes. Add your Azure OpenAI resource to the Conifer gateway and call your deployments with the same Conifer key. Usage is billed to your Azure agreement and Conifer adds no fee.
Request a briefing
To discuss a deployment for your agency or company, choose Government briefing or Enterprise briefing on the contact form.
Contact Conifer