✓ PASS

pydantic-ai 2.61.0

usage.reasoning-tokens · openai-responses

Requirements

Id	Level	Status	Evidence
total-reconciles	MUST	SATISFIED	usage.total=142 (primary); truth.usage.total=142
reasoning-reported	SHOULD	SATISFIED	usage.reasoning=58 (primary); truth.usage.reasoning=58

What the provider sent

Finish: stop
Raw finish: completed
Text: **11 pots** contain three seedlings. Check: \(11 \times 3 + 7 \times 2 = 47\), and \(11+7=18\).
Tool calls: []
Usage: { "alternatives": {}, "cached_input": 0, "input": 41, "output": 101, "raw": { "input_tokens": 41, "input_tokens_details": { "cache_write_tokens": 0, "cached_tokens": 0 }, "output_tokens": 101, "output_tokens_details": { "reasoning_tokens": 58 }, "total_tokens": 142 }, "reasoning": 58, "total": 142 }
Stream completed: null
Error: null

Wire excerpt

status: 200
content-type: application/json
body (json):
{
  "id": "resp_00e342ceb1471c1f006af116bad2c087d2bd36127d22f3641d",
  "object": "response",
  "created_at": 1794184890,
  "status": "completed",
  "access_programs": null,
  "background": false,
  "billing": {
    "payer": "developer"
  },
  "completed_at": 1794184892,
  "error": null,
  "frequency_penalty": 0.0,
  "image": {
    "context_compression": "disabled"
  },
  "incomplete_details": null,
  "instructions": null,
  "max_output_tokens": 800,
  "max_tool_calls": null,
  "model": "gpt-6-luna",
  "moderation": null,
  "output": [
    {
      "id": "rs_00e342ceb1471c1f006af116bb984487d2af1302c5a35b70db",
      "type": "reasoning",
      "content": [],
      "encrypted_content": "gAAAAABq8Ra8Mt6Wi-nHwLWIciIhKJBEMXcHvpIl-XmxDbsM0Ae8pUNYMXR3m846SrpDBeAhTtJBI5WREMOzYIEiI3c1wLDMlU2mzufpyzXovH9kBMEI3tuvDmR8XVMZeeqnUG-sydqD_wLWu9d2Yn6WIqU06Hq2W0rzLMkU4SG2tQVfOZ2tjhFr1BxvlsiMCddL_884mPxequBycDVge4Vp6cRf000PAWJQyL2A9RhPM9kNA1g68ra0rMz88TMy9U-kETCV_Jhsh4a7wch9HUXCobL76fiX7zTj0s6gAt1QACkFpNR28Ea672iEoNzsmoEalI_62mvmviliZicRZBxpKXWHuGprk_V3Qf2lDxd6uat_CfINwA4Uf71szy4kVF6_YBhtvAF3Rc4R4cetgVMWn6kbQZyXU_E1p3kZZZXcQ9M35gmHa3uZNSOHIcC12VosiynORs0NnEWZFzZLmCf6viyFJRWAiU7A3zy-OErooT_lo05YYGh1-frRR_wRYzS2hj-wSysOK_YDRlXN_CIrMiAOhtmboF34MZHDOrIYqrDXq7x4SULm-2QCK8o-w3XFS2qkOOIHcqoo06a2UoOvVQ3te_l30IHm6WLNBzEqbrszRypq_A6no4MrXFHzPa_9oD-ToywqMept5Y9oKiltrjl0i03QG6IETaAhqDE7RPl4t_SzkZgowWaxGkdEiVnWk9VKbmQDjXC_p4-78K36QeGty8bHLm9AeAHvfTpbeMFtqQHcmzFXEr5FoLJe4X75juxswML334NG2s0LiMbxUgYsScDbf7d6FHTRMtglNnzVt8inyhmITqSV3JyOaeSyJMo6izQpeBOnpl6DGFlVGfuPUJsmm3cnUmaC8vQkF8FSFU_pVaSNAlzqZJ3REsR-E0OCOmgn4FypHWj5uMxI7ZLLGlMDfT_Wu1eWp2hTTryNxXzjNAta0bwt0y3FdM5tV66zsq4vejBTf67zFN5mEHR7d7YUuU1yTh89Ad_1Kvr_iCpraN8frdTGLRkiw590fjbxRFQrs8Zk7Uyew4h-UDHa5-zIpinc0s55JfdH6u-TWdNfmK5TEbfuxm25dUOZtvjk8Bmak9_1AF2jxyptRFNLyrM2YYD0OnpgaRbU1D-VQpFdBU9b-7kseAHrQ2sAHmbVL8o_eV-TDfzZ4lpdOFpf1gpNc2g4Xz6Sn9wd2jQY1_tdEsbzQjgz0l5Z1dFsN08jZ46CD88d1_uNOiqo9y_Y44HJrcEmr3av2x3ZrPY0YM24gb36mWpVAGbSj1tqe32ojnsgImdCGbgCYY5VmvwSMCV3uzOtGZ-TeT1hBYtTaoPdVzJSJcVhHIA_VP6pS5VbjUNffKJdhfahzeqGZCWsQ1jceVOjLNCHYFClV1sLPD00G-N3xUZUYNiSeotNO1hficN-5eXyDbsTArDXT-gFsLJwvbTVbj3_NEyI8vsiyjlN8qbiMfdvTeDS7iWWxmQNajwxKDDxawTFX94S-ly1-dOxlOLdX5ylgHGsDdenJNB3sSdEmZ2a7DoDYjbeugKZEitKHN4qrKe-LXCLB6sV7hbzejNoeE5t_nstIeShCDjEbkUHLbb2G_rj0qHtfZNb2lmzTfskpkZ_i-USAsOQ8gbPXx8uCzSMOtOA3EJGnXHoHzr3v98yP02pJaCKRGdeyFa-WkjqQS15jmHqtysNYzb7s3DebZNgqPawNE9Vcwkwy2PAo8mASC4X-0cZc-fBeqj5GBTVfLff9Bj_u2zKxaK1gGRpi68UgXO-BjOjNZUfWIw7QTDU1a_MfZ3eSJyOc_iIfn2OB5eGerjMkhqMZsEs2DHNAhaShNkLVrP0fpqkayGIUgA-vf0B_6_nKb78G6kSa_9FX_-iXcXMq-_rjXE7kX5UaEp-gJZwk5gBJMuB4N4hZkGr5ktcpqrRxXWGID0vmMA3tCEveupqTqeQy7smqqvYBLR5tQyOd2rED6G5bGtP_8aPEPcWyhPq15_K_RIRVLg00cQD380dgddP3c06OcVOz2hO8J5klki0affbPtGgLun7HYBxZBQbBHlJ2Ean1lQzRPr6vFwLDJU5SP8OIqRvN5q_gSbqRSQifOEw2qyNFwK2iDgYSABoXGfFI47j",
      "summary": []
    },
    {
      "id": "msg_00e342ceb1471c1f006af116bc282487d284983d2f3b0acf52",
      "type": "message",
      "status": "completed",
      "content": [
        {
          "type": "output_text",
          "annotations": [],
          "logprobs": [],
          "text": "**11 pots** contain three seedlings. Check: \\(11 \\times 3 + 7 \\times 2 = 47\\), and \\(11+7=18\\)."
        }
      ],
      "phase": "final_answer",
      "role": "assistant"
    }
  ],
  "parallel_tool_calls": true,
  "presence_penalty": 0.0,
  "previous_response_id": null,
  "prompt_cache_key": null,
  "prompt_cache_retention": "24h",
  "reasoning": {
    "context": "all_turns",
    "effort": "medium",
    "mode": "standard",
    "summary": null
  },
  "safety_identifier": null,
  "service_tier": "default",
  "store": true,
  "temperature": 1.0,
  "text": {
    "format": {
      "type": "text"
    },
    "verbosity": "medium"
  },
  "tool_choice": "auto",
  "tool_usage": {
    "image_gen": {
      "input_tokens": 0,
      "input_tokens_details": {
        "image_tokens": 0,
        "text_tokens": 0
      },
      "output_tokens": 0,
      "output_tokens_details": {
        "image_tokens": 0,
        "text_tokens": 0
      },
      "total_tokens": 0
    },
    "web_search": {
      "num_requests": 0
    }
  },
  "tools": [],
  "top_logprobs": 0,
  "top_p": 0.98,
  "truncation": "disabled",
  "usage": {
    "input_tokens": 41,
    "input_tokens_details": {
      "cache_write_tokens": 0,
      "cached_tokens": 0
    },
    "output_tokens": 101,
    "output_tokens_details": {
      "reasoning_tokens": 58
    },
    "total_tokens": 142
  },
  "user": null,
  "metadata": {}
}

What the library reported

Outcome

returned

Finish

{
  "raw": "completed",
  "source": "ModelResponse.finish_reason",
  "surface": "primary",
  "value": "stop"
}

Text

Value: **11 pots** contain three seedlings. Check: \(11 \times 3 + 7 \times 2 = 47\), and \(11+7=18\).
Surface: primary

Tool calls

[]

Usage

{
  "cached_input": 0,
  "input": 41,
  "output": 101,
  "reasoning": 58,
  "surface": {
    "cached_input": "primary",
    "input": "primary",
    "output": "primary",
    "reasoning": "primary",
    "total": "primary"
  },
  "total": 142
}

Stream

{
  "chunks_seen": null,
  "completed": null,
  "used": false
}

Error

null

Unsupported reason

null

Full observation JSON

{
  "elapsed_ms": 416.68987087905407,
  "error": null,
  "finish": {
    "raw": "completed",
    "source": "ModelResponse.finish_reason",
    "surface": "primary",
    "value": "stop"
  },
  "format": "wiretruth.observation/v1",
  "library": {
    "api": "Agent.run",
    "language": "python",
    "name": "pydantic-ai",
    "version": "2.61.0"
  },
  "notes": [],
  "outcome": "returned",
  "stream": {
    "chunks_seen": null,
    "completed": null,
    "used": false
  },
  "structured": {
    "attempted": false,
    "returned_as_success": false,
    "value": null
  },
  "text": {
    "surface": "primary",
    "value": "**11 pots** contain three seedlings. Check: \\(11 \\times 3 + 7 \\times 2 = 47\\), and \\(11+7=18\\)."
  },
  "tool_calls": [],
  "unsupported_reason": null,
  "usage": {
    "cached_input": 0,
    "input": 41,
    "output": 101,
    "reasoning": 58,
    "surface": {
      "cached_input": "primary",
      "input": "primary",
      "output": "primary",
      "reasoning": "primary",
      "total": "primary"
    },
    "total": 142
  }
}

Fixture

recorded openai-responses/usage.reasoning-tokens

Provenance	Value
Recorded at	2026-11-09T00:41:30Z
Requested model	gpt-6-luna
Returned model	gpt-6-luna
CI run	https://github.com/kartsan03/wiretruth/actions/runs/42541528626

Reproduce

wiretruth serve openai-responses/usage.reasoning-tokens

Plain-library snippet from the shim manifest.

OpenAIResponsesModel(model, provider=OpenAIProvider(base_url=WIRETRUTH_BASE_URL_OPENAI_RESPONSES, api_key=WIRETRUTH_API_KEY))

Upstream

No matching upstream report.

History

Version	Grade
2.61.0	✓ PASS
2.56.0	not covered