Skip to content

Commit

Permalink
Browse files Browse the repository at this point in the history
  • Loading branch information
RossAscends committed Feb 16, 2025
2 parents 7ad4d98 + 9cbf615 commit 090d676
Showing 1 changed file with 6 additions and 0 deletions.
6 changes: 6 additions & 0 deletions Usage/Prompts/reasoning.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,10 @@ This information refers to a pre-release feature that is still in development. I

In language models, reasoning (also known as model thinking) refers to a chain-of-thought (CoT) technique that mirrors human problem-solving through step-by-step analysis. SillyTavern provides several features that make the use of reasoning models more efficient and consistent across supported backends.

## Common issues

1. When using reasoning models, the model's internal reasoning process consumes part of your response token allowance, even if this reasoning isn't shown in the final output (e.g. o3-mini or Gemini Thinking). If you notice your responses are coming back incomplete or empty, you should try adjusting the Max Response Length setting found in the **<i class="fa-solid fa-sliders"></i> AI Response Configuration** panel. For reasoning models, it's typical to use significantly higher token limits - anywhere from 1024 to 4096 tokens - compared to standard conversational models.

## Configuration

!!!
Expand All @@ -22,6 +26,8 @@ By default, reasoning blocks are collapsed to save space. Click a block to expan

When a reasoning block is expanded, you can copy or edit its contents using the **<i class="fa-solid fa-copy"></i> Copy** and **<i class="fa-solid fa-pencil"></i> Edit** buttons.

Some models models support reasoning, but will not send their thoughts back. It is possible to still show the reasoning block with reasoning time for those by toggling the **Show Hidden** setting.

## Adding Reasoning

### Manually
Expand Down

0 comments on commit 090d676

Please sign in to comment.