The Tech ArchiveThe Tech ArchiveThe Tech Archive
Small BusinessMarketingDevelopers
ArticlesTopicsSeriesAbout

Get the practical AI brief

Verified, no-hype AI tips you can actually use - in your inbox. Free.

No spam. We verify what we send. Unsubscribe anytime.

The Tech ArchiveThe Tech Archive

The Tech Archive

AI news, analysis & explainers

AboutSmall BusinessMarketingDevelopersArticlesTopicsSeriesMethodologyAI DisclosureCorrections

© 2026 All rights reserved.

Back to home
0 readers reading
  1. Home
  2. Articles
  3. Artificial Intelligence
  4. The AI Thinking Budget: How to Master 'Effort' Settings in GPT-5.6 and Claude

Contents

The AI Thinking Budget: How to Master 'Effort' Settings in GPT-5.6 and Claude
Artificial Intelligence

The AI Thinking Budget: How to Master 'Effort' Settings in GPT-5.6 and Claude

Learn how to use AI 'Effort' settings (Low, High, Max) to balance token cost and quality. Stop overthinking simple tasks and master the 2026 AI thinking budget.

Sham

Sham

AI Engineer & Founder, The Tech Archive

5 min read
0 views
July 14, 2026

Verdict: For 80% of daily AI tasks, Low or Medium effort is the optimal choice. Higher effort levels (High, Max, Ultra) are not "intelligence" toggles; they are reasoning budgets that can lead to over-engineering if used on simple problems. Save high-effort modes for long-running, multi-step tasks with high ambiguity.

Last verified: 2026-07-14 · Best for routine work: Low/Medium · Best for complex code: High/Ultra · Volatile facts: Token pricing and default effort levels change monthly.

What is the "AI Effort" setting and why does it matter?

A: Effort settings (like reasoning_effort in GPT-5.6 or budget_tokens in Claude) control the thinking budget allocated to a model before it responds. Unlike standard models that predict the next token instantly, 2026 models like GPT-5.6 Soul and Claude Fable 5 use an internal "thinking" phase to plan, verify, and ruminate on their output.

Increasing the effort level allows the model to spend more tokens on this internal reasoning. However, this comes with a direct cost in latency and token usage. According to Anthropic’s 2026 benchmark, a "High" effort path generates roughly 7x more tokens than a "Low" effort path for the identical prompt [Source: Anthropic Documentation 2026].

Effort vs. Intelligence: The "Slot Machine" mistake

A: Many users treat effort levels as a proxy for raw intelligence—assuming that "Max" effort unlocks a smarter brain. In reality, the underlying model weights (the "brain") remain the same.

Think of it as hiring a senior engineer. Low effort is that engineer giving you a quick answer based on experience. Max effort is that same engineer spending three days drafting a formal 50-page report, checking every edge case, and building five prototypes. If you only needed to know the color of a button, the "Max" path is a massive waste of time and money.

When to use Low, Medium, and High effort levels

A: Choosing the right level depends on the predictability and complexity of the task.

Effort Level Best For... Token Cost Verdict
Low / Minimal UI tweaks, file conversions, simple Q&A, and high-volume triage. 1x The default for routine work.
Medium Standard coding tasks, drafting articles, and data analysis. 2-3x The "safe" middle ground for most professional work.
High Complex logic, unknown errors, and tasks requiring multiple tool calls. 5-7x Use when you have "unknown unknowns."
Max / Ultra Researching new frameworks, long-running autonomous agents. 10x+ Rarely needed; can actually decrease quality on simple tasks.

For a deep dive into how these models automate complex workflows, see our guide on GPT-5.6 Sol's One-Prompt Engine.

The "Overthinking" Trap: Why Max effort can fail

A: Just as a student can "overthink" a simple multiple-choice question and change a correct answer to a wrong one, AI models can over-engineer solutions when given too much thinking budget.

In a recent test comparing Claude Code and Codex across 12 effort levels, the difference in final output between Medium and Max was often negligible. In some cases, the Max effort model added unnecessary complexity—like adding a favicon to a dashboard but losing the color-coding that made the data readable. Higher effort increases the chance of the model "ruminating" itself into a less direct, more expensive path.

The Harness Rule: Why the model is only 10% of the solution

A: Industry research suggests that the model itself only accounts for roughly 10% of the output quality; the remaining 90% is the harness (the tools, MCPs, and system environment) it operates in.

A frontier model on Low effort, equipped with the right tools—like those found in the Hermes Agent OS—will almost always outperform a smarter model with no tool access on Max effort. Focus your "budget" on giving the agent the right limbs (tools) rather than just more "brain time" (effort).

What this means for you

For small business owners and developers, the strategy is simple: Start at the bottom.

  1. Use Low effort for everything by default.
  2. Only escalate to Medium if the output feels shallow or misses constraints.
  3. Reserve High effort for tasks where you have already failed twice on Medium.
  4. Avoid Max/Ultra unless you are running a fully autonomous research sprint that will last 20+ minutes.

If you are building an automated team, consider using Hermes Agent Cloud to manage these persistent workflows without burning your local token cache.

FAQ

Q: Does higher effort make the model smarter? A: No. It gives the same model more "thinking budget" to ruminate, plan, and check its work. It doesn't change the underlying training or knowledge of the model.

Q: How much more do high-effort tasks cost? A: High-effort tasks can consume 5x to 10x more tokens than Low-effort ones. In 2026, where reasoning tokens are billed separately, this can significantly impact your API costs.

Q: Can I change effort mid-session? A: You can, but it's a "cache-invalidation trap." Effort levels are typically part of the prompt cache key. Changing them mid-session forces the model to re-read the entire conversation at full price, doubling your costs for that turn [Source: MCP.directory 2026].

Q: What is the best effort for coding tasks? A: For routine refactors or bug fixes, Medium is usually sufficient. For architectural changes or debugging complex race conditions, High is the recommended baseline.

Sources
  • Anthropic: Claude Code Performance Benchmarks (June 2026)
  • OpenAI: GPT-5 Developer Documentation (Reasoning Parameters Update)
  • MCP.directory: Claude Code Effort Levels Explained (July 2026)
  • MindStudio: Optimizing AI Thinking Budgets for Enterprise
Updates & Corrections
  • 2026-07-14 — Initial publication; verified effort level token ratios across Anthropic and OpenAI.

Get the practical AI brief

Verified, no-hype AI tips you can actually use - in your inbox. Free.

No spam. We verify what we send. Unsubscribe anytime.

Discussion

0 comments
Sham

Sham

AI Engineer & Founder, The Tech Archive

AI engineer (Azure AI-102/AI-900). Writes practical, tested, hype-free guides on using AI for real work and small business at The Tech Archive.

Related Articles

View all
Orbital AI Data Centers: Hype or the Future of Computing?
Artificial Intelligence

Orbital AI Data Centers: Hype or the Future of Computing?

6 min
Beyond Accuracy: How Item Response Theory Revolutionizes LLM Evaluation
Artificial Intelligence

Beyond Accuracy: How Item Response Theory Revolutionizes LLM Evaluation

9 min
GPT-5.6 Sol vs. Claude Fable 5: The 2026 Business Decision Guide
Artificial Intelligence

GPT-5.6 Sol vs. Claude Fable 5: The 2026 Business Decision Guide

5 min
AI Job Displacement: Why 200+ Economists and 16 Nobel Laureates Say 'Act Now
Artificial Intelligence

AI Job Displacement: Why 200+ Economists and 16 Nobel Laureates Say 'Act Now

6 min
Best AI Code Editor 2026: Cursor vs Copilot vs Claude Code vs Windsurf vs Cline
Artificial Intelligence

Best AI Code Editor 2026: Cursor vs Copilot vs Claude Code vs Windsurf vs Cline

9 min
Unlock AI Superpowers: How a Unified Agent OS Transforms Your Workflow with GPT-5.6
Artificial Intelligence

Unlock AI Superpowers: How a Unified Agent OS Transforms Your Workflow with GPT-5.6

6 min