✓ PASS
pydantic-ai 2.61.0
truncation.text · openai-chat
Requirements
| Id | Level | Status | Evidence |
|---|---|---|---|
| cause-is-truncation | MUST | SATISFIED | finish.value="length" (primary: ModelResponse.finish_reason); truth.finish="length"; error.category=null; structured.returned_as_success=false |
| text-reported | SHOULD | SATISFIED | text.value="Octopuses are masters of disguise, able to change colour in" (primary); truth.text="Octopuses are masters of disguise, able to change colour in" |
| usage-reported | SHOULD | SATISFIED | usage.input=24 (primary); truth.usage.input=24; usage.output=16 (primary); truth.usage.output=16 |
What the provider sent
- Finish
- length
- Raw finish
- length
- Text
- Octopuses are masters of disguise, able to change colour in
- Tool calls
[]
- Usage
{ "alternatives": {}, "cached_input": 0, "input": 24, "output": 16, "raw": { "completion_tokens": 16, "completion_tokens_details": { "accepted_prediction_tokens": 0, "audio_tokens": 0, "reasoning_tokens": 0, "rejected_prediction_tokens": 0 }, "prompt_tokens": 24, "prompt_tokens_details": { "audio_tokens": 0, "cache_write_tokens": 0, "cached_tokens": 0 }, "total_tokens": 40 }, "reasoning": 0, "total": 40 }- Stream completed
null
- Error
null
Wire excerpt
status: 200
content-type: application/json
body (json):
{
"id": "chatcmpl-EimShociVq0Gl4rntVsMeKkjOSf5m",
"object": "chat.completion",
"created": 1794341427,
"model": "gpt-6-luna",
"choices": [
{
"index": 0,
"message": {
"role": "assistant",
"content": "Octopuses are masters of disguise, able to change colour in",
"refusal": null,
"annotations": []
},
"finish_reason": "length"
}
],
"usage": {
"prompt_tokens": 24,
"completion_tokens": 16,
"total_tokens": 40,
"prompt_tokens_details": {
"cached_tokens": 0,
"cache_write_tokens": 0,
"audio_tokens": 0
},
"completion_tokens_details": {
"reasoning_tokens": 0,
"audio_tokens": 0,
"accepted_prediction_tokens": 0,
"rejected_prediction_tokens": 0
}
},
"service_tier": "default",
"system_fingerprint": null
}What the library reported
- Outcome
- returned
- Finish
{ "raw": "length", "source": "ModelResponse.finish_reason", "surface": "primary", "value": "length" }- Text
- Value
- Octopuses are masters of disguise, able to change colour in
- Surface
- primary
- Tool calls
[]
- Usage
{ "cached_input": 0, "input": 24, "output": 16, "reasoning": 0, "surface": { "cached_input": "primary", "input": "primary", "output": "primary", "reasoning": "primary", "total": "primary" }, "total": 40 }- Stream
{ "chunks_seen": null, "completed": null, "used": false }- Error
null
- Unsupported reason
null
Full observation JSON
{
"elapsed_ms": 201.70702412724495,
"error": null,
"finish": {
"raw": "length",
"source": "ModelResponse.finish_reason",
"surface": "primary",
"value": "length"
},
"format": "wiretruth.observation/v1",
"library": {
"api": "Agent.run",
"language": "python",
"name": "pydantic-ai",
"version": "2.61.0"
},
"notes": [],
"outcome": "returned",
"stream": {
"chunks_seen": null,
"completed": null,
"used": false
},
"structured": {
"attempted": false,
"returned_as_success": false,
"value": null
},
"text": {
"surface": "primary",
"value": "Octopuses are masters of disguise, able to change colour in"
},
"tool_calls": [],
"unsupported_reason": null,
"usage": {
"cached_input": 0,
"input": 24,
"output": 16,
"reasoning": 0,
"surface": {
"cached_input": "primary",
"input": "primary",
"output": "primary",
"reasoning": "primary",
"total": "primary"
},
"total": 40
}
}Fixture
recorded openai-chat/truncation.text
| Provenance | Value |
|---|---|
| Recorded at | 2026-11-10T20:10:26Z |
| Requested model | gpt-6-luna |
| Returned model | gpt-6-luna |
| CI run | https://github.com/kartsan03/wiretruth/actions/runs/42892575092 |
Reproduce
wiretruth serve openai-chat/truncation.textPlain-library snippet from the shim manifest.
OpenAIChatModel(model, provider=OpenAIProvider(base_url=WIRETRUTH_BASE_URL_OPENAI_CHAT, api_key=WIRETRUTH_API_KEY))Upstream
No matching upstream report.
History
| Version | Grade |
|---|---|
| 2.61.0 | ✓ PASS |
| 2.56.0 | ✓ PASS |