✓ PASS

litellm 1.105.5

truncation.structured-output · gemini

Back to results · Scenario

Requirements

IdLevelStatusEvidence
no-partial-successMUSTSATISFIEDstructured.attempted=true; structured.returned_as_success=false
cause-is-truncationMUSTSATISFIEDfinish.value="length" (primary: choices[0].finish_reason); truth.finish="length"; error.category=null; structured.returned_as_success=false
text-reportedSHOULDSATISFIEDtext.value="{\n \"islands\":" (primary); truth.text="{\n \"islands\":"
usage-reportedSHOULDSATISFIEDusage.input=19 (primary); truth.usage.input=19; usage.output=7 (primary); truth.usage.output=7

What the provider sent

Finish
length
Raw finish
MAX_TOKENS
Text
{ "islands":
Tool calls
[]
Usage
{
  "alternatives": {},
  "cached_input": null,
  "input": 19,
  "output": 7,
  "raw": {
    "candidatesTokenCount": 7,
    "promptTokenCount": 19,
    "promptTokensDetails": [
      {
        "modality": "TEXT",
        "tokenCount": 19
      }
    ],
    "serviceTier": "standard",
    "totalTokenCount": 26
  },
  "reasoning": null,
  "total": 26
}
Stream completed
null
Error
null
Wire excerpt
status: 200
content-type: application/json; charset=UTF-8
body (json):
{
  "candidates": [
    {
      "content": {
        "parts": [
          {
            "text": "{\n  \"islands\":",
            "thoughtSignature": "EmAKXgFpFH0TRpy3JZL2qd/cDtQmrps9PxfnU8+ovCZz1iEJU700MutHK0ZD2fh0jH2jIqIzPwG+U7gpx2LlBGanxSVs64JLIvaxP9PYvF/lXUxs9Yud2C1/hs4Hi8FAvMg="
          }
        ],
        "role": "model"
      },
      "finishReason": "MAX_TOKENS",
      "index": 0
    }
  ],
  "usageMetadata": {
    "promptTokenCount": 19,
    "candidatesTokenCount": 7,
    "totalTokenCount": 26,
    "promptTokensDetails": [
      {
        "modality": "TEXT",
        "tokenCount": 19
      }
    ],
    "serviceTier": "standard"
  },
  "modelVersion": "gemini-3.5-flash-lite",
  "responseId": "lwTOap6OEvjljMcPvYSCgAU"
}

What the library reported

Outcome
returned
Finish
{
  "raw": "MAX_TOKENS",
  "source": "choices[0].finish_reason",
  "surface": "primary",
  "value": "length"
}
Text
Value
{ "islands":
Surface
primary
Tool calls
[]
Usage
{
  "cached_input": null,
  "input": 19,
  "output": 7,
  "reasoning": null,
  "surface": {
    "cached_input": "absent",
    "input": "primary",
    "output": "primary",
    "reasoning": "absent",
    "total": "primary"
  },
  "total": 26
}
Stream
{
  "chunks_seen": null,
  "completed": null,
  "used": false
}
Error
null
Unsupported reason
null
Full observation JSON
{
  "elapsed_ms": 212.40968350321054,
  "error": null,
  "finish": {
    "raw": "MAX_TOKENS",
    "source": "choices[0].finish_reason",
    "surface": "primary",
    "value": "length"
  },
  "format": "wiretruth.observation/v1",
  "library": {
    "api": "litellm.completion",
    "language": "python",
    "name": "litellm",
    "version": "1.105.5"
  },
  "notes": [],
  "outcome": "returned",
  "stream": {
    "chunks_seen": null,
    "completed": null,
    "used": false
  },
  "structured": {
    "attempted": true,
    "returned_as_success": false,
    "value": null
  },
  "text": {
    "surface": "primary",
    "value": "{\n  \"islands\":"
  },
  "tool_calls": [],
  "unsupported_reason": null,
  "usage": {
    "cached_input": null,
    "input": 19,
    "output": 7,
    "reasoning": null,
    "surface": {
      "cached_input": "absent",
      "input": "primary",
      "output": "primary",
      "reasoning": "absent",
      "total": "primary"
    },
    "total": 26
  }
}

Fixture

recorded gemini/truncation.structured-output

ProvenanceValue
Recorded at2026-10-13T10:14:47Z
Requested modelgemini-3.5-flash-lite
Returned modelgemini-3.5-flash-lite
CI runhttps://github.com/kartsan03/wiretruth/actions/runs/38381941285

Reproduce

wiretruth serve gemini/truncation.structured-output

Plain-library snippet from the shim manifest.

litellm.completion(model='gemini/' + model, api_base=WIRETRUTH_BASE_URL_GEMINI + '/v1beta', api_key=WIRETRUTH_API_KEY); the runner supplies the host root and LiteLLM appends /models/...

Upstream

No matching upstream report.

History

VersionGrade
1.105.5✓ PASS
1.105.1✓ PASS