✗ WRONG

litellm 1.105.5

tools.parallel-calls · gemini

Requirements

Id	Level	Status	Evidence
calls-reported	MUST	CONTRADICTED	tool_calls[0] id="call_120847__thought__EmAKXgFpFH0TucStVhN+6mgGthmi4ZTSeXOraFjbeCmsoaavB5dIA0B5vGZy5k0Pzv8P83Tu07mHaNUyxKlTdDTX4/jln5bEXkbPUr0u5/9V2FRkpP2krwRNuCvFaArPNjk=", name="get_weather", args={"city": "São Paulo"}, parsed=true; truth id="call_120847", name="get_weather", args={"city": "São Paulo"}, parsed=true; tool_calls[1] id="call_120848", name="get_weather", args={"city": "Zürich"}, parsed=true; truth id="call_120848", name="get_weather", args={"city": "Zürich"}, parsed=true

What the provider sent

Finish: tool_calls
Raw finish: STOP
Text: null
Tool calls: [ { "arguments": { "city": "São Paulo" }, "arguments_parsed_ok": true, "arguments_raw": "{\"city\":\"São Paulo\"}", "id": "call_120847", "name": "get_weather" }, { "arguments": { "city": "Zürich" }, "arguments_parsed_ok": true, "arguments_raw": "{\"city\":\"Zürich\"}", "id": "call_120848", "name": "get_weather" } ]
Usage: { "alternatives": {}, "cached_input": null, "input": 69, "output": 34, "raw": { "candidatesTokenCount": 34, "promptTokenCount": 69, "promptTokensDetails": [ { "modality": "TEXT", "tokenCount": 69 } ], "serviceTier": "standard", "totalTokenCount": 103 }, "reasoning": null, "total": 103 }
Stream completed: null
Error: null

Wire excerpt

status: 200
content-type: application/json; charset=UTF-8
body (json):
{
  "candidates": [
    {
      "content": {
        "parts": [
          {
            "functionCall": {
              "name": "get_weather",
              "args": {
                "city": "São Paulo"
              },
              "id": "call_120847"
            },
            "thoughtSignature": "EmAKXgFpFH0TucStVhN+6mgGthmi4ZTSeXOraFjbeCmsoaavB5dIA0B5vGZy5k0Pzv8P83Tu07mHaNUyxKlTdDTX4/jln5bEXkbPUr0u5/9V2FRkpP2krwRNuCvFaArPNjk="
          },
          {
            "functionCall": {
              "name": "get_weather",
              "args": {
                "city": "Zürich"
              },
              "id": "call_120848"
            }
          }
        ],
        "role": "model"
      },
      "finishReason": "STOP",
      "index": 0,
      "finishMessage": "Model generated function call(s)."
    }
  ],
  "usageMetadata": {
    "promptTokenCount": 69,
    "candidatesTokenCount": 34,
    "totalTokenCount": 103,
    "promptTokensDetails": [
      {
        "modality": "TEXT",
        "tokenCount": 69
      }
    ],
    "serviceTier": "standard"
  },
  "modelVersion": "gemini-3.5-flash-lite",
  "responseId": "jQTOasLtM62a9MoPzJKqyAg"
}

What the library reported

Outcome

returned

Finish

{
  "raw": "STOP",
  "source": "choices[0].finish_reason",
  "surface": "primary",
  "value": "tool_calls"
}

Text

Value: null
Surface: absent

Tool calls

[
  {
    "arguments": {
      "city": "São Paulo"
    },
    "arguments_parsed_ok": true,
    "arguments_raw": "{\"city\": \"São Paulo\"}",
    "id": "call_120847__thought__EmAKXgFpFH0TucStVhN+6mgGthmi4ZTSeXOraFjbeCmsoaavB5dIA0B5vGZy5k0Pzv8P83Tu07mHaNUyxKlTdDTX4/jln5bEXkbPUr0u5/9V2FRkpP2krwRNuCvFaArPNjk=",
    "name": "get_weather"
  },
  {
    "arguments": {
      "city": "Zürich"
    },
    "arguments_parsed_ok": true,
    "arguments_raw": "{\"city\": \"Zürich\"}",
    "id": "call_120848",
    "name": "get_weather"
  }
]

Usage

{
  "cached_input": null,
  "input": 69,
  "output": 34,
  "reasoning": null,
  "surface": {
    "cached_input": "absent",
    "input": "primary",
    "output": "primary",
    "reasoning": "absent",
    "total": "primary"
  },
  "total": 103
}

Stream

{
  "chunks_seen": null,
  "completed": null,
  "used": false
}

Error

null

Unsupported reason

null

Full observation JSON

{
  "elapsed_ms": 220.62067408114672,
  "error": null,
  "finish": {
    "raw": "STOP",
    "source": "choices[0].finish_reason",
    "surface": "primary",
    "value": "tool_calls"
  },
  "format": "wiretruth.observation/v1",
  "library": {
    "api": "litellm.completion",
    "language": "python",
    "name": "litellm",
    "version": "1.105.5"
  },
  "notes": [],
  "outcome": "returned",
  "stream": {
    "chunks_seen": null,
    "completed": null,
    "used": false
  },
  "structured": {
    "attempted": false,
    "returned_as_success": false,
    "value": null
  },
  "text": {
    "surface": "absent",
    "value": null
  },
  "tool_calls": [
    {
      "arguments": {
        "city": "São Paulo"
      },
      "arguments_parsed_ok": true,
      "arguments_raw": "{\"city\": \"São Paulo\"}",
      "id": "call_120847__thought__EmAKXgFpFH0TucStVhN+6mgGthmi4ZTSeXOraFjbeCmsoaavB5dIA0B5vGZy5k0Pzv8P83Tu07mHaNUyxKlTdDTX4/jln5bEXkbPUr0u5/9V2FRkpP2krwRNuCvFaArPNjk=",
      "name": "get_weather"
    },
    {
      "arguments": {
        "city": "Zürich"
      },
      "arguments_parsed_ok": true,
      "arguments_raw": "{\"city\": \"Zürich\"}",
      "id": "call_120848",
      "name": "get_weather"
    }
  ],
  "unsupported_reason": null,
  "usage": {
    "cached_input": null,
    "input": 69,
    "output": 34,
    "reasoning": null,
    "surface": {
      "cached_input": "absent",
      "input": "primary",
      "output": "primary",
      "reasoning": "absent",
      "total": "primary"
    },
    "total": 103
  }
}

Fixture

recorded gemini/tools.parallel-calls

Provenance	Value
Recorded at	2026-10-13T10:14:37Z
Requested model	gemini-3.5-flash-lite
Returned model	gemini-3.5-flash-lite
CI run	https://github.com/kartsan03/wiretruth/actions/runs/38381941285

Reproduce

wiretruth serve gemini/tools.parallel-calls

Plain-library snippet from the shim manifest.

litellm.completion(model='gemini/' + model, api_base=WIRETRUTH_BASE_URL_GEMINI + '/v1beta', api_key=WIRETRUTH_API_KEY); the runner supplies the host root and LiteLLM appends /models/...

Upstream

reported Issue

Fixed in: not specified

Existing upstream issue, not opened by wiretruth. LiteLLM deliberately appends __thought__ and the thought signature to the provider's tool-call id for OpenAI client compatibility (https://github.com/BerriAI/litellm/blob/v1.105.1/litellm/litellm_core_utils/prompt_templates/factory.py#L1163-L1179). Both suite cells preserve names, arguments and the second id, but the first id differs from the wire. The issue tracks interoperability failures caused by this encoding; the shim reports the exposed id unchanged.

History

Version	Grade
1.105.5	✗ WRONG
1.105.1	✗ WRONG