# Chain-of-Thought Reasoning (CoT)

URL: https://www.onsomble.ai/tools/ai-glossary/chain-of-thought-reasoning

Published: 2026-03-14 14:09:00.000Z

A prompting technique that improves LLM accuracy on complex tasks by guiding the model to show its reasoning step-by-step before arriving at a final answer.

Category: Developer Experience

## How It Works

Chain-of-thought prompting asks the model to produce intermediate reasoning steps rather than jumping straight to a conclusion. Instead of asking "What is 47 times 83?" and getting a potentially wrong snap answer, you prompt the model to break it down: multiply the ones, carry, multiply the tens, add the partial products. This mirrors how humans handle complex problems — decomposing them into manageable sub-steps where each builds on the last. The technique works because LLMs are autoregressive: each generated token conditions on all previous tokens. By generating reasoning tokens first, the model effectively gives itself a scratchpad, making the correct final answer more likely to follow from its own intermediate work.

## Key Variants

**Zero-shot CoT** is the simplest form — just append "Let's think step by step" to your prompt. Surprisingly effective for a technique that requires zero examples. **Few-shot CoT** provides worked examples in the prompt, showing the model the reasoning format you expect. This gives more control over the style and depth of reasoning. **Self-consistency** takes it further by sampling multiple reasoning paths at higher temperature and taking a majority vote on the final answer — different reasoning chains might make different errors, but the correct answer tends to appear most frequently. **Tree-of-thought** extends the linear chain into branching exploration, letting the model consider and evaluate multiple approaches before committing.

## When to Use It

CoT shines on tasks that require genuine multi-step reasoning: math word problems, logical deductions, code debugging, multi-hop question answering. The accuracy gains on these tasks can be dramatic — turning a 40% success rate into 80%+. But it's not always the right tool. **Simple factual lookups** ("What is the capital of France?") don't benefit from step-by-step reasoning and just waste tokens. **Classification tasks** with straightforward criteria rarely need CoT either. The trade-off is always latency and cost: more reasoning tokens mean longer responses and higher bills. Use CoT when the accuracy gain justifies the overhead.

## Related terms

- [Prompt Engineering](https://www.onsomble.ai/tools/ai-glossary/prompt-engineering)
- [Large Language Model](https://www.onsomble.ai/tools/ai-glossary/large-language-model)
- [Token](https://www.onsomble.ai/tools/ai-glossary/token)

## Related Radar topics

- [Reasoning Models](https://www.onsomble.ai/tools/ai-radar/reasoning-models)

## Related articles

### [Gaslighting Your AI Into Better Results: What the Research Actually Shows](https://www.onsomble.ai/blog/high-stakes-prompting-llm-quality)

A Reddit post about telling Claude you work at a hospital went viral. Turns out there's actual research explaining why this works across all LLMs.

Rosh Jayawardena · Published 2026-01-29T12:00:00+00:00 · Updated 2026-08-02T12:12:41.52786+00:00 · 8 min
