02
Why a stronger model can be the wrong default
The first hidden cost is task frequency. Inline completion, a short API explanation, a one-file rename, and a basic unit-test stub may not need a long reasoning process. GitHub states that code completions and next edit suggestions are not billed in AI Credits for paid plans, while interactive model requests are token-metered. That makes it important to separate completion-heavy work from agentic or chat-heavy work. (GitHub model billing documentation)
The second cost is context size. A repository-wide request may include source files, test files, configuration, previous messages, tool results, and cached context. Even when the final answer is short, the input can be large. GitHub’s billing documentation explains that input, cached input, and output tokens all contribute to usage. There is no reliable “one request equals one credit” rule.
The third issue is latency and review load. A deeper model can spend more time reasoning and may produce a larger patch. That can be useful when the task is genuinely difficult, but it also creates more material for a developer to inspect. A small change that could have been completed through Auto may become slower to validate if Opus 5 rewrites unrelated code.
The fourth issue is false confidence. GitHub describes strong early results for Opus 5 in agentic workflows, including autonomous changes, regression verification, and multi-tool coordination. Those are GitHub’s early testing conclusions, not an independent benchmark or a guarantee for a particular Swift codebase. (GitHub’s Claude Opus 5 announcement)
For that reason, we would not use a star rating. A rating hides the conditions that determine whether a model is useful. The more defensible test is whether the model improves the completed result after tests, review, and rework are included.