How Bull.inf works
A two-sided marketplace for LLM inference. Sellers list capacity. Buyers call one OpenAI-compatible API. Settlement is in $ANSEM on Solana.
01 The idea in one minute
Sellers connect an OpenAI-compatible upstream (OpenRouter, Venice, Groq, a self-hosted box, etc.), pick a model, set a discount, and list an offer. They earn $ANSEM when buyers route through them.
Buyers get an inf_… key, fund a ledger balance, and call
/v1/chat/completions like OpenAI. Bull.inf picks the cheapest matching offer and pays the seller.
02 Buy inference — step by step
- Open the market desk Go to /market and sign in with a Solana wallet (Privy).
- Get an API key Buy panel → deposit $ANSEM (Approve + Load), then Get key. Calls debit your loaded balance. Settlement is only in $ANSEM — no card, no USD.
- Fund → Approve → Load Hold $ANSEM in your wallet, Approve the treasury as spend delegate, then Load into your ledger. Chat spends from ledger credit.
- Check the board Live offers on the desk. If a model has no sellers yet, requests fail until someone lists — see Empty markets.
-
Call the API
Use your
inf_…key against the OpenAI-compatible base URL.
curl https://YOUR_API_HOST/v1/chat/completions \
-H "Authorization: Bearer inf_your_key" \
-H "Content-Type: application/json" \
-d '{
"model": "claude-opus-4-8",
"messages": [{"role": "user", "content": "Hello"}]
}'
Default routing uses trusted seller upstreams only.
Opt into unverified sellers under Get key → Routing preferences (or PATCH /api/buyer/routing).
03 Sell capacity — step by step
- Sign in on /market Same wallet login as buyers. Open List offer.
- Pick a trusted provider (recommended) Allowlisted hosts (e.g. OpenRouter, Venice, Groq). These offers show up for default buyers.
- Or use a custom URL (advanced) Any OpenAI-compatible base URL. Listing is unverified — buyers must opt in. Acknowledge the notice before listing.
- Choose model + discount Catalog model id and price vs list. Platform take-rate comes from the seller side.
- Get paid Earnings accrue on the ledger. Ops settles batches as SPL $ANSEM to your Solana wallet.
04 Trusted vs unverified sellers
Trusted
Allowlisted provider hosts. Default buyer routing includes these. No extra opt-in.
Unverified
Custom / unknown hosts. Show an Unverified badge. Buyers must opt in before traffic can reach them.
The market can list anything OpenAI-compatible; buyers choose whether to trust unknown endpoints with their prompts.
05 BYOK — optional, not the main path
Bring-your-own-key lets you register a private upstream. Chat tries it before marketplace sellers. On success you pay a thin relay fee (default ~2% of the marketplace quote); the seller gets $0. Your lab/provider bills you separately for the tokens.
Use BYOK when you already have a lab key, or need a model no seller lists.
Skip BYOK when you just want market inference — fund, get a key, call /v1.
06 If markets look empty
An empty board means no one has listed an offer yet — not that buyers must use BYOK. Until at least one seller lists a trusted offer for a model, chat for that model has nowhere to route.