✓ PASS

any-llm 1.40.2

usage.reasoning-tokens · gemini

Requirements

Id	Level	Status	Evidence
total-reconciles	MUST	SATISFIED	usage.total=520 (primary); truth.usage.total=520
reasoning-reported	SHOULD	SATISFIED	usage.reasoning=388 (primary); truth.usage.reasoning=388

What the provider sent

Finish: stop
Raw finish: STOP
Text: There are **11** pots containing three seedlings. **Check:** * 11 pots with 3 seedlings: $11 \times 3 = 33$ seedlings * 7 pots with 2 seedlings: $7 \times 2 = 14$ seedlings * Total pots: $11 + 7 = 18$ * Total seedlings: $33 + 14 = 47$
Tool calls: []
Usage: { "alternatives": { "output": { "candidates_only": 94 } }, "cached_input": null, "input": 38, "output": 482, "raw": { "candidatesTokenCount": 94, "promptTokenCount": 38, "promptTokensDetails": [ { "modality": "TEXT", "tokenCount": 38 } ], "serviceTier": "standard", "thoughtsTokenCount": 388, "totalTokenCount": 520 }, "reasoning": 388, "total": 520 }
Stream completed: null
Error: null

Wire excerpt

status: 200
content-type: application/json; charset=UTF-8
body (json):
{
  "candidates": [
    {
      "content": {
        "parts": [
          {
            "text": "There are **11** pots containing three seedlings.\n\n**Check:**\n* 11 pots with 3 seedlings: $11 \\times 3 = 33$ seedlings\n* 7 pots with 2 seedlings: $7 \\times 2 = 14$ seedlings\n* Total pots: $11 + 7 = 18$\n* Total seedlings: $33 + 14 = 47$",
            "thoughtSignature": "ErQICrEIAWkUfROzqHINc+6GqZic3chQbPkCTEtZFq2MxjgJAdg4cIMVKvYdN/iXWSnd2IQCu7fNEl27x6+hFs7V2qvNNlalzHXTh3Em3OtquaLydVpqgDDnnWiSnYiYj6nS4sDi/5Ubbvr3O2323JD9qfqNZV0R3McF06ga/SPCeA7d0H8Vd0I4lywrbwvDWGhJdjVxPc4vQGO2ugF0QFVQdhdmdOOo9qJVsNlA0+KcN1VswRzLY80rOqrr4lIFVpEnObG7s+NnrOWN76XueI9IqMg7qoM/kqUlv4V/LscRSGPeYJOBngD5Dd+00n+KaccF9/BV6OronZx+kcPgwPgl5H0fk1BtZfmnTZwU9NDgPAHreR5IujvcWzkjKffGJ7bhIGehJTTDkUapOmlOrveTStSQ7B8n6d8K4PuvbHLpFb72jKyb0X9ZshkcJTUnRaqLoxA+LIgufBzJq6HHa6VOiLicq4qveKqEcvirW7icMj5qnOTswg66atwQKrHUGYMG4Hn5XMXkLUdPRXUHol02eQSQp9W4RUSjCPUyCS4m+BSpkINsbt8gZt7ChwDtFLJIld3FhskaLkg2v8PA5EXYTsHBrD6qCj7M6pz4M3hZSvMvZmQYw/SQMJNUmkvi8ZoHJ7fON60C+9FtXeeg4lS/Jz+T5WUw/c3481oAxwiUzCqitsQsHHD9RI+9qNtF+qu+Nom3UE96FIdfjrC6SSCpu3YanEpBTk/H7IRNYEjZ289RhETaw35a9xSuIYq41YfiOiMCZ8vTyK3bFjjC2pI4i+ISHQd/SnISqK6flVFoPTCvGoZesrK2NSUlJTekZCRKetzMtBs4AI98H2wh+wYY7QTqBto7tvz2JHBwp1GG8tPTpUaqP4dBj+7ZD4Sn2xeTQEB3CrN0nxOc2/71jLZi6Ic0IWtB8v7t/RtLpPqDUI7YtLbLxg+INGy25m4K2OCuMGZIBzIyDc+wIISUYCaTb52Kvdfg2Zy+hppplHdH4nG8U2WqrFnQZfZxNDbU33ZF6mcp/+J6YgeEdH2mLWB9IaHhfIjg2o36NB24nhs7j98ieAJiPgrnvKO466JH0nqycSfTHPCfQY2hGB1PUJ5s23RbeaFlKobievvvTs8qaXsr9CN9QyjAuQ9t8UErKTw6dkpyl/cDd8nPOgtbsM2fG8BX+Seh+y90DEsXrZc8kY/l3N8jxYOt3XZkaoBKF/JXgQIygHvxm5KOcEYlieqUn0Jb316MPXEa+B2VFfQxvZ6KUEuwvIAybNgJg2ZYQ16ei6BWuDmHeYLJPONyNEzTqWR5R2CjhPrUTwhL6I2eViE1VQ0wI5X0eJ7Hl9UxTWXfTNMUTA4aj2/KoaY7yuIWImPjHPBYnh+OLi3n7GmFUWvHEs+GBIixqT2FJjLrHdEkO7CL+PqPs1EO9OsZdxG6lXjYG2A="
          }
        ],
        "role": "model"
      },
      "finishReason": "STOP",
      "index": 0
    }
  ],
  "usageMetadata": {
    "promptTokenCount": 38,
    "candidatesTokenCount": 94,
    "totalTokenCount": 520,
    "promptTokensDetails": [
      {
        "modality": "TEXT",
        "tokenCount": 38
      }
    ],
    "thoughtsTokenCount": 388,
    "serviceTier": "standard"
  },
  "modelVersion": "gemini-3.8-flash",
  "responseId": "6QTOaqCSENz0jrEP_IzRiAs"
}

What the library reported

Outcome

returned

Finish

{
  "raw": "stop",
  "source": "choices[0].finish_reason",
  "surface": "primary",
  "value": "stop"
}

Text

Value: There are **11** pots containing three seedlings. **Check:** * 11 pots with 3 seedlings: $11 \times 3 = 33$ seedlings * 7 pots with 2 seedlings: $7 \times 2 = 14$ seedlings * Total pots: $11 + 7 = 18$ * Total seedlings: $33 + 14 = 47$
Surface: primary

Tool calls

[]

Usage

{
  "cached_input": null,
  "input": 38,
  "output": 482,
  "reasoning": 388,
  "surface": {
    "cached_input": "absent",
    "input": "primary",
    "output": "primary",
    "reasoning": "primary",
    "total": "primary"
  },
  "total": 520
}

Stream

{
  "chunks_seen": null,
  "completed": null,
  "used": false
}

Error

null

Unsupported reason

null

Full observation JSON

{
  "elapsed_ms": 717.3303496092558,
  "error": null,
  "finish": {
    "raw": "stop",
    "source": "choices[0].finish_reason",
    "surface": "primary",
    "value": "stop"
  },
  "format": "wiretruth.observation/v1",
  "library": {
    "api": "any_llm.completion",
    "language": "python",
    "name": "any-llm",
    "version": "1.40.2"
  },
  "notes": [],
  "outcome": "returned",
  "stream": {
    "chunks_seen": null,
    "completed": null,
    "used": false
  },
  "structured": {
    "attempted": false,
    "returned_as_success": false,
    "value": null
  },
  "text": {
    "surface": "primary",
    "value": "There are **11** pots containing three seedlings.\n\n**Check:**\n* 11 pots with 3 seedlings: $11 \\times 3 = 33$ seedlings\n* 7 pots with 2 seedlings: $7 \\times 2 = 14$ seedlings\n* Total pots: $11 + 7 = 18$\n* Total seedlings: $33 + 14 = 47$"
  },
  "tool_calls": [],
  "unsupported_reason": null,
  "usage": {
    "cached_input": null,
    "input": 38,
    "output": 482,
    "reasoning": 388,
    "surface": {
      "cached_input": "absent",
      "input": "primary",
      "output": "primary",
      "reasoning": "primary",
      "total": "primary"
    },
    "total": 520
  }
}

Fixture

recorded gemini/usage.reasoning-tokens

Provenance	Value
Recorded at	2026-10-13T10:16:09Z
Requested model	gemini-3.8-flash
Returned model	gemini-3.8-flash
CI run	https://github.com/kartsan03/wiretruth/actions/runs/38381937993

Reproduce

wiretruth serve gemini/usage.reasoning-tokens

Plain-library snippet from the shim manifest.

any_llm.completion(model=model, provider='gemini', api_base=WIRETRUTH_BASE_URL_GEMINI, api_key=WIRETRUTH_API_KEY); host-root base URL

Upstream

No matching upstream report.

History

Version	Grade
1.40.2	✓ PASS
1.38.0	✓ PASS
1.33.0	✓ PASS