Skip output decoding.
The model reads the input in a forward pass. It does not spend additional decoding steps writing an answer token by token.
A language model for making deicisions when speed matters.
Explore the modelIn software, an AI response often becomes a branch, a field, or a score. The application needs the value to take its next step.
decision-machine-1 scores labels and extracts values directly from text. For these bounded tasks, it skips the token-by-token generation an LLM uses—even with structured outputs.
Read the model rationale“Losing sales,
fix this today.”
Is the customer expressing urgency?
Probability of urgency 1.00
/yes-no response. Your code can use the boolean to raise a ticket’s priority.The model reads the input in a forward pass. It does not spend additional decoding steps writing an answer token by token.
Supply labels to choose between, questions to answer from the source, or fields to extract.
A classification includes the full score distribution and confidence. Your code can see when two labels compete, instead of treating every winner alike.
Choose the labels, questions, or fields your application needs.
Flag messages that need a faster response.
{ "text": "Losing sales, fix this today.",
"statement": "The customer expresses urgency." }Use this flag to raise the ticket’s priority.
{ "answer": true, "probability": 1 }Choose a destination from your support queues.
{ "text": "My card was charged twice this month.",
"labels": ["billing","shipping","technical","other"] }Use the label to select the billing queue.
{ "label": "billing", "probability": 0.74,
"confidence": 0.555,
"scores": { "billing": 0.74, "shipping": 0.001,
"technical": 0.008, "other": 0.25 } }Turn customer frustration into a sortable score.
{ "text": "Third time I write. Nobody answers.",
"scale": ["calm","annoyed","angry","furious"] }Nearly tied levels signal uncertainty. Keep it visible when ranking the queue.
{ "score": 1.998, "level": 1,
"confidence": 0.208,
"scores": [0, 0.334, 0.334, 0.332] }Locate the shipment destination in a status update.
{ "text": "The shipment reached the Halifax warehouse on September 6, two days after the promised date.",
"questions": ["Where did the shipment arrive?"] }Source offsets let your application show where the answer came from.
{ "results": [ { "answer": "Halifax warehouse",
"probability": 0.992, "start": 25, "end": 42 } ] }Map invoice text to the fields in your records.
{ "text": "Invoice #A-1042 from Nordik Supply, due 2026-10-01, total 4,250.00 CAD, net 30.",
"schema": { "type": "object", "properties": {
"invoice_number": { "type": "string" },
"vendor": { "type": "string" },
"total": { "type": "number" },
"currency": { "type": "string" } } } }Invoice fields ready for validation before writing a record.
{ "data": { "invoice_number": "A-1042",
"vendor": "Nordik Supply",
"total": 4250, "currency": "CAD" } }Identify people, organizations, and references in a claim note.
{ "text": "Marie Tremblay from Desjardins called about claim 44812 on March 3.",
"types": ["person","organization","claim_id","date"] }Typed values for search and record matching.
{ "entities": [
{ "type": "person", "text": "Marie Tremblay", "probability": 0.999 },
{ "type": "organization", "text": "Desjardins", "probability": 0.997 },
{ "type": "claim_id", "text": "claim 44812", "probability": 0.714 },
{ "type": "date", "text": "March 3", "probability": 0.997 } ] }Check a proposed deductible against the policy text.
{ "text": "Policy holder: Jean Roy. Deductible $500.",
"field": { "name": "deductible" },
"value": "$1000" }The source says $500. The proposed value is $1,000.
{ "matches": false, "probability": 0,
"found": ["$500"] }Use a decision call first, then accept results that meet your thresholds, and send ambiguous cases to an LLM or a person.
That can reduce large-model calls. It also adds a first step, so measure the cost and latency of the whole path on your traffic.
Build an LLM cascadeprobability >= 0.90
confidence >= 0.70Screen incoming messages. Check extracted fields. Cost follows the text you send, with no output-token charge.
Start buildingper million input tokens
100 million input tokens cost $4. Each call bills its input, including repeated text.
Try a classification or extraction call you already send to an LLM. Compare accuracy, latency, and cost on representative inputs.
Use plain HTTP, or reuse your OpenAI client for supported structured-output and tool-call requests.
Read the quickstartcurl https://api.milliseconds.ai/v1/decision-machine-1/yes-no \
-H "Content-Type: application/json" \
-d '{"text":"Losing sales, fix this today.",
"statement":"The customer expresses urgency."}'{ "answer": true, "probability": 1 }No API key required during launch. Standard usage pricing applies.
No. A well-formed response can still contain a wrong value. Evaluate on your own data, validate business rules, and review consequential or ambiguous results. Verification can check a value against the source; it is not a guarantee of correctness.
Use an LLM for writing, conversation, multi-step reasoning, or judgments that need knowledge beyond the supplied text. Use milliseconds when the task has defined labels, questions, or fields.
For classification, probability is the winning label’s share of the scores. Confidence describes how concentrated the whole distribution is. Neither is a guarantee that the answer is right. Other capabilities return different scoring fields; tune thresholds for the task and the cost of a mistake.
Yes, for JSON-schema extraction and tool calls. Set the base URL to https://api.milliseconds.ai/v1 and select decision-machine-1. This is not a drop-in chat model: plain chat is unsupported, and the compatibility layer reads user turns only.