✓ PASS
litellm 1.105.5
truncation.structured-output · gemini
Requirements
| Id | Level | Status | Evidence |
|---|---|---|---|
| no-partial-success | MUST | SATISFIED | structured.attempted=true; structured.returned_as_success=false |
| cause-is-truncation | MUST | SATISFIED | finish.value="length" (primary: choices[0].finish_reason); truth.finish="length"; error.category=null; structured.returned_as_success=false |
| text-reported | SHOULD | SATISFIED | text.value="{\n \"islands\":" (primary); truth.text="{\n \"islands\":" |
| usage-reported | SHOULD | SATISFIED | usage.input=19 (primary); truth.usage.input=19; usage.output=7 (primary); truth.usage.output=7 |
What the provider sent
- Finish
- length
- Raw finish
- MAX_TOKENS
- Text
- { "islands":
- Tool calls
[]
- Usage
{ "alternatives": {}, "cached_input": null, "input": 19, "output": 7, "raw": { "candidatesTokenCount": 7, "promptTokenCount": 19, "promptTokensDetails": [ { "modality": "TEXT", "tokenCount": 19 } ], "serviceTier": "standard", "totalTokenCount": 26 }, "reasoning": null, "total": 26 }- Stream completed
null
- Error
null
Wire excerpt
status: 200
content-type: application/json; charset=UTF-8
body (json):
{
"candidates": [
{
"content": {
"parts": [
{
"text": "{\n \"islands\":",
"thoughtSignature": "EmAKXgFpFH0TRpy3JZL2qd/cDtQmrps9PxfnU8+ovCZz1iEJU700MutHK0ZD2fh0jH2jIqIzPwG+U7gpx2LlBGanxSVs64JLIvaxP9PYvF/lXUxs9Yud2C1/hs4Hi8FAvMg="
}
],
"role": "model"
},
"finishReason": "MAX_TOKENS",
"index": 0
}
],
"usageMetadata": {
"promptTokenCount": 19,
"candidatesTokenCount": 7,
"totalTokenCount": 26,
"promptTokensDetails": [
{
"modality": "TEXT",
"tokenCount": 19
}
],
"serviceTier": "standard"
},
"modelVersion": "gemini-3.5-flash-lite",
"responseId": "lwTOap6OEvjljMcPvYSCgAU"
}What the library reported
- Outcome
- returned
- Finish
{ "raw": "MAX_TOKENS", "source": "choices[0].finish_reason", "surface": "primary", "value": "length" }- Text
- Value
- { "islands":
- Surface
- primary
- Tool calls
[]
- Usage
{ "cached_input": null, "input": 19, "output": 7, "reasoning": null, "surface": { "cached_input": "absent", "input": "primary", "output": "primary", "reasoning": "absent", "total": "primary" }, "total": 26 }- Stream
{ "chunks_seen": null, "completed": null, "used": false }- Error
null
- Unsupported reason
null
Full observation JSON
{
"elapsed_ms": 212.40968350321054,
"error": null,
"finish": {
"raw": "MAX_TOKENS",
"source": "choices[0].finish_reason",
"surface": "primary",
"value": "length"
},
"format": "wiretruth.observation/v1",
"library": {
"api": "litellm.completion",
"language": "python",
"name": "litellm",
"version": "1.105.5"
},
"notes": [],
"outcome": "returned",
"stream": {
"chunks_seen": null,
"completed": null,
"used": false
},
"structured": {
"attempted": true,
"returned_as_success": false,
"value": null
},
"text": {
"surface": "primary",
"value": "{\n \"islands\":"
},
"tool_calls": [],
"unsupported_reason": null,
"usage": {
"cached_input": null,
"input": 19,
"output": 7,
"reasoning": null,
"surface": {
"cached_input": "absent",
"input": "primary",
"output": "primary",
"reasoning": "absent",
"total": "primary"
},
"total": 26
}
}Fixture
recorded gemini/truncation.structured-output
| Provenance | Value |
|---|---|
| Recorded at | 2026-10-13T10:14:47Z |
| Requested model | gemini-3.5-flash-lite |
| Returned model | gemini-3.5-flash-lite |
| CI run | https://github.com/kartsan03/wiretruth/actions/runs/38381941285 |
Reproduce
wiretruth serve gemini/truncation.structured-outputPlain-library snippet from the shim manifest.
litellm.completion(model='gemini/' + model, api_base=WIRETRUTH_BASE_URL_GEMINI + '/v1beta', api_key=WIRETRUTH_API_KEY); the runner supplies the host root and LiteLLM appends /models/...Upstream
No matching upstream report.
History
| Version | Grade |
|---|---|
| 1.105.5 | ✓ PASS |
| 1.105.1 | ✓ PASS |