✓ PASS
litellm 1.105.5
tools.parallel-calls-stream · openai-responses
Requirements
| Id | Level | Status | Evidence |
|---|---|---|---|
| calls-reported | MUST | SATISFIED | tool_calls[0] id="call_29SkAhtIVyQRGcDwkCOwQydm", name="get_weather", args={"city": "São Paulo"}, parsed=true; truth id="call_29SkAhtIVyQRGcDwkCOwQydm", name="get_weather", args={"city": "São Paulo"}, parsed=true; tool_calls[1] id="call_ZrtYQmfXyQrL0cWXfULamGz8", name="get_weather", args={"city": "Zürich"}, parsed=true; truth id="call_ZrtYQmfXyQrL0cWXfULamGz8", name="get_weather", args={"city": "Zürich"}, parsed=true |
What the provider sent
- Finish
- tool_calls
- Raw finish
- completed
- Text
null
- Tool calls
[ { "arguments": { "city": "São Paulo" }, "arguments_parsed_ok": true, "arguments_raw": "{\"city\":\"São Paulo\"}", "id": "call_29SkAhtIVyQRGcDwkCOwQydm", "name": "get_weather" }, { "arguments": { "city": "Zürich" }, "arguments_parsed_ok": true, "arguments_raw": "{\"city\":\"Zürich\"}", "id": "call_ZrtYQmfXyQrL0cWXfULamGz8", "name": "get_weather" } ]- Usage
{ "alternatives": {}, "cached_input": 0, "input": 65, "output": 51, "raw": { "input_tokens": 65, "input_tokens_details": { "cache_write_tokens": 0, "cached_tokens": 0 }, "output_tokens": 51, "output_tokens_details": { "reasoning_tokens": 0 }, "total_tokens": 116 }, "reasoning": 0, "total": 116 }- Stream completed
true
- Error
null
Wire excerpt
status: 200
content-type: text/event-stream; charset=utf-8
body (sse):
event: response.created
data: {"type":"response.created","response":{"id":"resp_072c2a293c344388006acbfbf9a01087d1adabf13eee0e8d98","object":"response","created_at":1791753209,"status":"in_progress","access_programs":null,"background":false,"completed_at":null,"error":null,"frequency_penalty":0.0,"incomplete_details":null,"instructions":null,"max_output_tokens":null,"max_tool_calls":null,"model":"gpt-6-luna","moderation":null,"output":[],"parallel_tool_calls":true,"presence_penalty":0.0,"previous_response_id":null,"prompt_cache_key":null,"prompt_cache_retention":"24h","reasoning":{"context":"all_turns","effort":"none","mode":"standard","summary":null},"safety_identifier":null,"service_tier":"auto","store":true,"temperature":1.0,"text":{"format":{"type":"text"},"verbosity":"medium"},"tool_choice":"auto","tool_usage":{"image_gen":{"input_tokens":0,"input_tokens_details":{"image_tokens":0,"text_tokens":0},"output_tokens":0,"output_tokens_details":{"image_tokens":0,"text_tokens":0},"total_tokens":0},"web_search":{"num_requests":0}},"tools":[{"type":"function","description":"Get the current weather for a city.","name":"get_weather","output_schema":null,"parameters":{"type":"object","properties":{"city":{"type":"string"}},"required":["city"],"additionalProperties":false},"strict":true}],"top_logprobs":0,"top_p":0.98,"truncation":"disabled","usage":null,"user":null,"metadata":{}},"sequence_number":0}
event: response.in_progress
data: {"type":"response.in_progress","response":{"id":"resp_072c2a293c344388006acbfbf9a01087d1adabf13eee0e8d98","object":"response","created_at":1791753209,"status":"in_progress","access_programs":null,"background":false,"completed_at":null,"error":null,"frequency_penalty":0.0,"incomplete_details":null,"instructions":null,"max_output_tokens":null,"max_tool_calls":null,"model":"gpt-6-luna","moderation":null,"output":[],"parallel_tool_calls":true,"presence_penalty":0.0,"previous_response_id":null,"prompt_cache_key":null,"prompt_cache_retention":"24h","reasoning":{"context":"all_turns","effort":"none","mode":"standard","summary":null},"safety_identifier":null,"service_tier":"auto","store":true,"temperature":1.0,"text":{"format":{"type":"text"},"verbosity":"medium"},"tool_choice":"auto","tool_usage":{"image_gen":{"input_tokens":0,"input_tokens_details":{"image_tokens":0,"text_tokens":0},"output_tokens":0,"output_tokens_details":{"image_tokens":0,"text_tokens":0},"total_tokens":0},"web_search":{"num_requests":0}},"tools":[{"type":"function","description":"Get the current weather for a city.","name":"get_weather","output_schema":null,"parameters":{"type":"object","properties":{"city":{"type":"string"}},"required":["city"],"additionalProperties":false},"strict":true}],"top_logprobs":0,"top_p":0.98,"truncation":"disabled","usage":null,"user":null,"metadata":{}},"sequence_number":1}
event: response.output_item.added
data: {"type":"response.output_item.added","item":{"id":"fc_072c2a293c344388006acbfbfab83c87d1bda0cc03d00a13db","type":"function_call","status":"in_progress","arguments":"","call_id":"call_29SkAhtIVyQRGcDwkCOwQydm","name":"get_weather"},"output_index":0,"sequence_number":2}
event: response.function_call_arguments.delta
data: {"type":"response.function_call_arguments.delta","delta":"{\"city\":\"São Paulo\"}","item_id":"fc_072c2a293c344388006acbfbfab83c87d1bda0cc03d00a13db","obfuscation":"ALycK5dJBEZI","output_index":0,"sequence_number":3}
event: response.function_call_arguments.done
data: {"type":"response.function_call_arguments.done","arguments":"{\"city\":\"São Paulo\"}","item_id":"fc_072c2a293c344388006acbfbfab83c87d1bda0cc03d00a13db","output_index":0,"sequence_number":4}
event: response.output_item.done
data: {"type":"response.output_item.done","item":{"id":"fc_072c2a293c344388006acbfbfab83c87d1bda0cc03d00a13db","type":"function_call","status":"completed","arguments":"{\"city\":\"São Paulo\"}","call_id":"call_29SkAhtIVyQRGcDwkCOwQydm","name":"get_weather"},"output_index":0,"sequence_number":5}
event: response.output_item.added
data: {"type":"response.output_item.added","item":{"id":"fc_072c2a293c344388006acbfbfab84c87d186778b23d0e6410e","type":"function_call","status":"in_progress","arguments":"","call_id":"call_ZrtYQmfXyQrL0cWXfULamGz8","name":"get_weather"},"output_index":1,"sequence_number":6}
event: response.function_call_arguments.delta
data: {"type":"response.function_call_arguments.delta","delta":"{\"city\":\"Zürich\"}","item_id":"fc_072c2a293c344388006acbfbfab84c87d186778b23d0e6410e","obfuscation":"Y6bSyT1uFi599nT","output_index":1,"sequence_number":7}
event: response.function_call_arguments.done
data: {"type":"response.function_call_arguments.done","arguments":"{\"city\":\"Zürich\"}","item_id":"fc_072c2a293c344388006acbfbfab84c87d186778b23d0e6410e","output_index":1,"sequence_number":8}
event: response.output_item.done
data: {"type":"response.output_item.done","item":{"id":"fc_072c2a293c344388006acbfbfab84c87d186778b23d0e6410e","type":"function_call","status":"completed","arguments":"{\"city\":\"Zürich\"}","call_id":"call_ZrtYQmfXyQrL0cWXfULamGz8","name":"get_weather"},"output_index":1,"sequence_number":9}
event: response.completed
data: {"type":"response.completed","response":{"id":"resp_072c2a293c344388006acbfbf9a01087d1adabf13eee0e8d98","object":"response","created_at":1791753209,"status":"completed","access_programs":null,"background":false,"completed_at":1791753210,"error":null,"frequency_penalty":0.0,"incomplete_details":null,"instructions":null,"max_output_tokens":null,"max_tool_calls":null,"model":"gpt-6-luna","moderation":null,"output":[{"id":"fc_072c2a293c344388006acbfbfab83c87d1bda0cc03d00a13db","type":"function_call","status":"completed","arguments":"{\"city\":\"São Paulo\"}","call_id":"call_29SkAhtIVyQRGcDwkCOwQydm","name":"get_weather"},{"id":"fc_072c2a293c344388006acbfbfab84c87d186778b23d0e6410e","type":"function_call","status":"completed","arguments":"{\"city\":\"Zürich\"}","call_id":"call_ZrtYQmfXyQrL0cWXfULamGz8","name":"get_weather"}],"parallel_tool_calls":true,"presence_penalty":0.0,"previous_response_id":null,"prompt_cache_key":null,"prompt_cache_retention":"24h","reasoning":{"context":"all_turns","effort":"none","mode":"standard","summary":null},"safety_identifier":null,"service_tier":"default","store":true,"temperature":1.0,"text":{"format":{"type":"text"},"verbosity":"medium"},"tool_choice":"auto","tool_usage":{"image_gen":{"input_tokens":0,"input_tokens_details":{"image_tokens":0,"text_tokens":0},"output_tokens":0,"output_tokens_details":{"image_tokens":0,"text_tokens":0},"total_tokens":0},"web_search":{"num_requests":0}},"tools":[{"type":"function","description":"Get the current weather for a city.","name":"get_weather","output_schema":null,"parameters":{"type":"object","properties":{"city":{"type":"string"}},"required":["city"],"additionalProperties":false},"strict":true}],"top_logprobs":0,"top_p":0.98,"truncation":"disabled","usage":{"input_tokens":65,"input_tokens_details":{"cache_write_tokens":0,"cached_tokens":0},"output_tokens":51,"output_tokens_details":{"reasoning_tokens":0},"total_tokens":116},"user":null,"metadata":{}},"sequence_number":10}
What the library reported
- Outcome
- returned
- Finish
{ "raw": "completed", "source": "status", "surface": "primary", "value": "tool_calls" }- Text
- Value
null
- Surface
- absent
- Tool calls
[ { "arguments": { "city": "São Paulo" }, "arguments_parsed_ok": true, "arguments_raw": "{\"city\":\"São Paulo\"}", "id": "call_29SkAhtIVyQRGcDwkCOwQydm", "name": "get_weather" }, { "arguments": { "city": "Zürich" }, "arguments_parsed_ok": true, "arguments_raw": "{\"city\":\"Zürich\"}", "id": "call_ZrtYQmfXyQrL0cWXfULamGz8", "name": "get_weather" } ]- Usage
{ "cached_input": 0, "input": 65, "output": 51, "reasoning": 0, "surface": { "cached_input": "primary", "input": "primary", "output": "primary", "reasoning": "primary", "total": "primary" }, "total": 116 }- Stream
{ "chunks_seen": 11, "completed": true, "used": true }- Error
null
- Unsupported reason
null
Full observation JSON
{
"elapsed_ms": 213.70495576411486,
"error": null,
"finish": {
"raw": "completed",
"source": "status",
"surface": "primary",
"value": "tool_calls"
},
"format": "wiretruth.observation/v1",
"library": {
"api": "litellm.responses",
"language": "python",
"name": "litellm",
"version": "1.105.5"
},
"notes": [],
"outcome": "returned",
"stream": {
"chunks_seen": 11,
"completed": true,
"used": true
},
"structured": {
"attempted": false,
"returned_as_success": false,
"value": null
},
"text": {
"surface": "absent",
"value": null
},
"tool_calls": [
{
"arguments": {
"city": "São Paulo"
},
"arguments_parsed_ok": true,
"arguments_raw": "{\"city\":\"São Paulo\"}",
"id": "call_29SkAhtIVyQRGcDwkCOwQydm",
"name": "get_weather"
},
{
"arguments": {
"city": "Zürich"
},
"arguments_parsed_ok": true,
"arguments_raw": "{\"city\":\"Zürich\"}",
"id": "call_ZrtYQmfXyQrL0cWXfULamGz8",
"name": "get_weather"
}
],
"unsupported_reason": null,
"usage": {
"cached_input": 0,
"input": 65,
"output": 51,
"reasoning": 0,
"surface": {
"cached_input": "primary",
"input": "primary",
"output": "primary",
"reasoning": "primary",
"total": "primary"
},
"total": 116
}
}Fixture
recorded openai-responses/tools.parallel-calls-stream
| Provenance | Value |
|---|---|
| Recorded at | 2026-10-11T21:13:28Z |
| Requested model | gpt-6-luna |
| Returned model | gpt-6-luna |
| CI run | https://github.com/kartsan03/wiretruth/actions/runs/38175457862 |
Reproduce
wiretruth serve openai-responses/tools.parallel-calls-streamPlain-library snippet from the shim manifest.
litellm.responses(model='openai/' + model, api_base=WIRETRUTH_BASE_URL_OPENAI_RESPONSES, api_key=WIRETRUTH_API_KEY)Upstream
No matching upstream report.
History
| Version | Grade |
|---|---|
| 1.105.5 | ✓ PASS |
| 1.105.1 | ✓ PASS |