✓ PASS
pydantic-ai 2.61.0
truncation.reasoning-only · ollama-openai
Requirements
| Id | Level | Status | Evidence |
|---|---|---|---|
| cause-is-truncation | MUST | SATISFIED | finish.value="length" (raw: ModelResponse.finish_reason); truth.finish="length"; error.category="truncation"; structured.returned_as_success=false |
| text-reported | MUST | SATISFIED | text.value=null (absent); truth.text="" |
| usage-reported | SHOULD | NOT_OBSERVABLE | usage.output=64 (raw); truth.usage.output=64 |
What the provider sent
- Finish
- length
- Raw finish
- length
- Text
- Tool calls
[]
- Usage
{ "alternatives": {}, "cached_input": 0, "input": 54, "output": 64, "raw": { "completion_tokens": 64, "prompt_tokens": 54, "prompt_tokens_details": { "cached_tokens": 0 }, "total_tokens": 118 }, "reasoning": null, "total": 118 }- Stream completed
null
- Error
null
Wire excerpt
status: 200
content-type: application/json
body (json):
{
"id": "chatcmpl-741",
"object": "chat.completion",
"created": 1791831679,
"model": "qwen3.5:0.8b",
"system_fingerprint": "fp_ollama",
"choices": [
{
"index": 0,
"message": {
"role": "assistant",
"content": "",
"reasoning": "Here's my thought process for finding the smallest positive whole number with these constraints:\n\n1. **Understand the Goal:** I need to find a specific integer $x$ satisfying three conditions simultaneously:\n * Condition A (Modulo): $x \\equiv 1 \\pmod{2}$ ("
},
"finish_reason": "length"
}
],
"usage": {
"prompt_tokens": 54,
"prompt_tokens_details": {
"cached_tokens": 0
},
"completion_tokens": 64,
"total_tokens": 118
}
}What the library reported
- Outcome
- raised
- Finish
{ "raw": "length", "source": "ModelResponse.finish_reason", "surface": "raw", "value": "length" }- Text
- Value
null
- Surface
- absent
- Tool calls
[]
- Usage
{ "cached_input": 0, "input": 54, "output": 64, "reasoning": 0, "surface": { "cached_input": "raw", "input": "raw", "output": "raw", "reasoning": "raw", "total": "raw" }, "total": 118 }- Stream
{ "chunks_seen": null, "completed": null, "used": false }- Error
- Type
- pydantic_ai.exceptions.UnexpectedModelBehavior
- Message
- Model token limit (64) exceeded before any response was generated. Increase the `max_tokens` model setting, or simplify the prompt to result in a shorter response that will fit within the limit.
- Category
- truncation
- Retry after
null
- Stack top
- pydantic_ai/_agent_graph.py:2495
- Unsupported reason
null
Full observation JSON
{
"elapsed_ms": 240.34519493579865,
"error": {
"category": "truncation",
"message": "Model token limit (64) exceeded before any response was generated. Increase the `max_tokens` model setting, or simplify the prompt to result in a shorter response that will fit within the limit.",
"retry_after": null,
"stack_top": "pydantic_ai/_agent_graph.py:2495",
"type": "pydantic_ai.exceptions.UnexpectedModelBehavior"
},
"finish": {
"raw": "length",
"source": "ModelResponse.finish_reason",
"surface": "raw",
"value": "length"
},
"format": "wiretruth.observation/v1",
"library": {
"api": "Agent.run",
"language": "python",
"name": "pydantic-ai",
"version": "2.61.0"
},
"notes": [],
"outcome": "raised",
"stream": {
"chunks_seen": null,
"completed": null,
"used": false
},
"structured": {
"attempted": false,
"returned_as_success": false,
"value": null
},
"text": {
"surface": "absent",
"value": null
},
"tool_calls": [],
"unsupported_reason": null,
"usage": {
"cached_input": 0,
"input": 54,
"output": 64,
"reasoning": 0,
"surface": {
"cached_input": "raw",
"input": "raw",
"output": "raw",
"reasoning": "raw",
"total": "raw"
},
"total": 118
}
}Fixture
recorded ollama-openai/truncation.reasoning-only
| Provenance | Value |
|---|---|
| Recorded at | 2026-10-12T19:01:16Z |
| Requested model | qwen3.5:0.8b |
| Returned model | qwen3.5:0.8b |
| CI run | https://github.com/kartsan03/wiretruth/actions/runs/38294739276 |
Reproduce
wiretruth serve ollama-openai/truncation.reasoning-onlyPlain-library snippet from the shim manifest.
OllamaModel(model, provider=OllamaProvider(base_url=WIRETRUTH_BASE_URL_OLLAMA_OPENAI, api_key=WIRETRUTH_API_KEY)); /v1 baseUpstream
No matching upstream report.
History
| Version | Grade |
|---|---|
| 2.61.0 | ✓ PASS |
| 2.56.0 | ✓ PASS |