✓ PASS
any-llm 1.40.2
truncation.reasoning-only · openai-chat
Requirements
| Id | Level | Status | Evidence |
|---|---|---|---|
| cause-is-truncation | MUST | SATISFIED | finish.value="length" (primary: choices[0].finish_reason); truth.finish="length"; error.category=null; structured.returned_as_success=false |
| text-reported | MUST | SATISFIED | text.value="" (primary); truth.text="" |
| usage-reported | SHOULD | SATISFIED | usage.output=64 (primary); truth.usage.output=64 |
What the provider sent
- Finish
- length
- Raw finish
- length
- Text
- Tool calls
[]
- Usage
{ "alternatives": {}, "cached_input": 0, "input": 49, "output": 64, "raw": { "completion_tokens": 64, "completion_tokens_details": { "accepted_prediction_tokens": 0, "audio_tokens": 0, "reasoning_tokens": 64, "rejected_prediction_tokens": 0 }, "prompt_tokens": 49, "prompt_tokens_details": { "audio_tokens": 0, "cache_write_tokens": 0, "cached_tokens": 0 }, "total_tokens": 113 }, "reasoning": 64, "total": 113 }- Stream completed
null
- Error
null
Wire excerpt
status: 200
content-type: application/json
body (json):
{
"id": "chatcmpl-EXmWY18aHzANfC6JTSbCvBtmeGdRS",
"object": "chat.completion",
"created": 1791720058,
"model": "gpt-6-luna",
"choices": [
{
"index": 0,
"message": {
"role": "assistant",
"content": "",
"refusal": null,
"annotations": []
},
"finish_reason": "length"
}
],
"usage": {
"prompt_tokens": 49,
"completion_tokens": 64,
"total_tokens": 113,
"prompt_tokens_details": {
"cached_tokens": 0,
"cache_write_tokens": 0,
"audio_tokens": 0
},
"completion_tokens_details": {
"reasoning_tokens": 64,
"audio_tokens": 0,
"accepted_prediction_tokens": 0,
"rejected_prediction_tokens": 0
}
},
"service_tier": "default",
"system_fingerprint": null
}What the library reported
- Outcome
- returned
- Finish
{ "raw": "length", "source": "choices[0].finish_reason", "surface": "primary", "value": "length" }- Text
- Value
- Surface
- primary
- Tool calls
[]
- Usage
{ "cached_input": 0, "input": 49, "output": 64, "reasoning": 64, "surface": { "cached_input": "primary", "input": "primary", "output": "primary", "reasoning": "primary", "total": "primary" }, "total": 113 }- Stream
{ "chunks_seen": null, "completed": null, "used": false }- Error
null
- Unsupported reason
null
Full observation JSON
{
"elapsed_ms": 191.44371524453163,
"error": null,
"finish": {
"raw": "length",
"source": "choices[0].finish_reason",
"surface": "primary",
"value": "length"
},
"format": "wiretruth.observation/v1",
"library": {
"api": "any_llm.completion",
"language": "python",
"name": "any-llm",
"version": "1.40.2"
},
"notes": [],
"outcome": "returned",
"stream": {
"chunks_seen": null,
"completed": null,
"used": false
},
"structured": {
"attempted": false,
"returned_as_success": false,
"value": null
},
"text": {
"surface": "primary",
"value": ""
},
"tool_calls": [],
"unsupported_reason": null,
"usage": {
"cached_input": 0,
"input": 49,
"output": 64,
"reasoning": 64,
"surface": {
"cached_input": "primary",
"input": "primary",
"output": "primary",
"reasoning": "primary",
"total": "primary"
},
"total": 113
}
}Fixture
recorded openai-chat/truncation.reasoning-only
| Provenance | Value |
|---|---|
| Recorded at | 2026-10-11T12:00:57Z |
| Requested model | gpt-6-luna |
| Returned model | gpt-6-luna |
| CI run | https://github.com/kartsan03/wiretruth/actions/runs/38137650119 |
Reproduce
wiretruth serve openai-chat/truncation.reasoning-onlyPlain-library snippet from the shim manifest.
any_llm.completion(model=model, provider='openai', api_base=WIRETRUTH_BASE_URL_OPENAI_CHAT, api_key=WIRETRUTH_API_KEY)Upstream
No matching upstream report.
History
| Version | Grade |
|---|---|
| 1.40.2 | ✓ PASS |
| 1.38.0 | ✓ PASS |
| 1.33.0 | ✓ PASS |