Token Limits

Every plan includes a Context token limit. Understanding this limit helps you make the most of the text and file content available to the AI.

What are tokens?#

Tokens are the units AI models use to process text. They're not quite words — they're pieces of words.

A simple conversion: 1 token ≈ 0.75 words

So when you see "30,000 tokens", think roughly 22,500 words.

Common words use 1 token. Longer words might use 2-3 tokens. Punctuation and spaces count too. The AI model breaks down text into these tokens to understand and generate language.

Limits by plan#

Each plan includes a different Context capacity:

• Trial, Starter, Standard, and Pro: 30,000 tokens (~22,500 words)
• Business: 50,000 tokens (~37,500 words)
• Enterprise: 100,000 tokens by default, with custom higher limits available

These limits apply per project. If you have multiple projects, each has its own token allowance.

Checking your usage#

The Context tab shows your current usage at the top:

Knowledge context usage
8,234 / 30,000 tokens

This updates in real-time as you add or remove items.

You can also see the token count for individual items in the Context tab, helping you identify which entries use the most capacity.

Staying within limits#

If you're approaching your token limit, here are strategies to manage usage:

Prioritize the most relevant context: What does the AI absolutely need to know? Product features and pricing usually matter more than company history.

Remove outdated entries: Deleted that feature? Changed your pricing? Remove the old context to free up tokens.

Summarize before uploading: Instead of uploading a 50-page product manual, create a condensed version highlighting key points.

Split large topics: Instead of one massive "Product Guide" file, break it into focused items like "Core Features", "Integrations", "Pricing", etc. Then you can remove less critical pieces if needed.

Use concise language: The AI doesn't need flowery marketing copy. Clear, factual descriptions work better and use fewer tokens.

What happens at the limit#

When you've used all available tokens, you cannot add new context items.

You'll see an error message indicating you're at capacity.

To add new content, you must either:

• Delete existing items to free up tokens
• Upgrade to a plan with a higher token limit

Your existing context continues working normally. The limit only prevents adding new context.

Upgrading for more capacity#

If you consistently hit your token limit, consider upgrading:

• If you need more than 50,000 tokens per project, contact the Diaform team about an Enterprise setup.

Navigate to your organization settings and click Billing to view upgrade options.

Tips for efficient token usage#

Test and iterate: Add context gradually. Upload your core documentation, run some test interviews, then add more based on gaps you notice.

Quality over quantity: Focused, well-organized context of 15,000 tokens often outperforms sprawling, unfocused context at 30,000 tokens.

Use external links for details: Context should give the AI useful background, not serve as a complete encyclopedia. Link to full docs when appropriate.

Review regularly: Set a reminder to review your context quarterly. Remove what's outdated, update what's changed, and optimize what's staying.