Simon Willison·· 15 天前AI 评分18
llm-echo 0.5 发布：调试插件更新模拟 token 用量统计
llm-echo 0.5
AI 导读
Simon Willison 发布 llm-echo 0.5，这个调试插件提供一个不涉及 LLM 的“模型”，只把收到的提示词原样回显。
摘要与补充说明
新版本更新了模拟 token 用量计数，将工具调用、系统提示词和推理 token 纳入统计。示例中通过 `uvx --with llm-echo llm -m echo 'hi there' -o thinking 1 --usage` 调用，输出显示 2 个输入 token、24 个输出 token。该插件用于配合即将到来的新 LLM 版本测试 PR。
正文
I'm working towards a new LLM release, and testing PRs caused me to revisit the llm-echo debug plugin. This plugin provides a "model" which doesn't involve an LLM at all - it just repeats back the prompts that have been fed to it. The new release now updates the simulated token usage counts to take tool calls, system prompts, and reasoning tokens into account.
Example usage:
uvx --with llm-echo llm -m echo 'hi there' -o thinking 1 --usage
Outputs:
First I consider the prompt, then I decide what to say.
{
"prompt": "hi there",
"system": "",
"attachments": [],
"stream": true,
"previous": []
}
Token usage: 2 input, 24 output