AI Glossary

Tokens

What it means, why it matters to your business, and where it shows up in a real build decision.

In plain terms

Tokens are the small chunks of text that AI models read and generate, roughly three-quarters of a word each, and the unit most AI usage is billed in. Your AI running cost is essentially a token bill. Longer prompts and longer answers cost more, so cost control is a design decision, not an afterthought.

A simple analogy

Tokens are to AI what minutes are to a phone plan. You are billed for every word in, every word out, and every system prompt. Volume is what drives the bill.

What it looks like in practice

A team builds a reporting assistant that summarizes 10-page PDFs. At scale the per-report token cost makes the unit economics break. Redesigning the prompt to send only key sections cuts running cost by 70 percent.

When to use it

Token counting belongs in every AI cost model from day one. Map your typical input and output sizes before you pick a model and before you price any product feature.

When to avoid it

You cannot avoid tokens; you can optimize them. Caching repeated system prompts, truncating unnecessary context, and routing simple tasks to smaller models are the main levers.

What it signals about cost

The primary unit of ongoing AI cost.

Work with us

Put this to work on a real problem.

Tell us what's slowing you down and we'll show you where AI development fits.

Work with us

Tell us what's broken.

Tell us what's not working in your business. We'll find the real problem and tell you exactly what it would take to fix it.

  • Scope and cost agreed before work starts. No surprises. No obligation.
  • Working prototype within 3 weeks of kickoff.
  • Pay by milestone. You see progress before each invoice.
  • 60-day post-launch warranty. Bug fixes, UI tweaks, and deployment support. No retainer.
  • All conversations are NDA-protected.